SlideShare a Scribd company logo

Computer Vision - now working
 in over 2 Billion Web Browsers!

This was presented at Augmented World Expo in Santa Clara (#AWE2017). A video of the live Natural Feature Tracking demo will be uploaded and linked from here soon. The key benefit of using AR in your web browser is how quick and easy it is to share. You can send a single web link through social media or email and the recipient can just tap on the link and it works. But up until recently this has not included Computer Vision based AR for a number of technical and market reasons. This presentation will position the web browser in the overall context of Computer Vision history, and we'll look at how this has evolved through developments including jsartoolkit.js, tracking.js and AR.js. We'll then dive deeper into the latest developments to show how OpenCV performs running in the browser and how this compares to native applications. This deep dive will compare the different feature detection/extraction algorithms and how they perform on some well known image data sets. The session will conclude with demos that show how this all works right now in over 2 Billion capable web browsers.

1 of 15
Download to read offline
Computer Vision - now working

in over 2 Billion Web Browsers!
Rob Manson

CEO & co-founder
Sebastian Montabone

Computer Vision Engineer
Mixed Reality. In the web. On any device.
https://try.awe.media
Computer Vision - now working
 in over 2 Billion Web Browsers!
So what is Mixed Reality?
Here’s a short demo of Milgram’s Mixed Reality Continuum - all running in a browser.
awe.media
A brief/biased history of Computer Vision
1957 - Russel A. Kirsch scans first photo with a computer
1960 - Larry Roberts publishes thesis at MIT
1964 - First facial recognition system (unamed intelligence agency)
1976 - UK Police create first License Plate recognition system
1978 - David Marr proposes edge detection framework at MIT
1985 - Lockheed Martin/Carnegie Mellon create first self-driving land vehicle
1992 - Tom Caudell at Boeing coins the term Augmented Reality
1999 - Billinghurst & Kato publish/demo ARToolkit at IWAR/SIGGRAPH
2000 - Windows only alpha version of OpenCV launched at CVPR
2007 - OpenCV 1.0 released
2008 - ARToolkit ported to Flash by @saqoosha
2011 - ARToolkit ported to Javascript by Ilmari Heikkinen
2011 - FastCV/Vuforia 1.0 released
2017 - Facebook adds Computer Vision to their camera app
2017 - OpenCV in the browser demonstrated here
awe.media
How does Computer Vision

work in the browser?
awe.media
camera -> gUM -> video -> canvas -> pixels -> vision algorithms
HTMLVideoElement
This is a container for decoding and presenting video streams.
This brought plugin free video to the web.
awe.media

Recommended

More Related Content

What's hot

Phare Conference - Steve Clayton, NUI
Phare Conference - Steve Clayton, NUIPhare Conference - Steve Clayton, NUI
Phare Conference - Steve Clayton, NUISteve Clayton
 
Virtual reality Simple and Atractive presentation
Virtual reality Simple and Atractive presentationVirtual reality Simple and Atractive presentation
Virtual reality Simple and Atractive presentationSUJESH T V
 
Theinternetofthings pastpresentfuture-140213100418-phpapp01
Theinternetofthings pastpresentfuture-140213100418-phpapp01Theinternetofthings pastpresentfuture-140213100418-phpapp01
Theinternetofthings pastpresentfuture-140213100418-phpapp01Kavita Aroor
 
Designing for an Augmented Reality world
Designing for an Augmented Reality worldDesigning for an Augmented Reality world
Designing for an Augmented Reality worldthomas.purves
 
3. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-13. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-1Javier Daza
 
Tessel: The End of Web Development (as we know it)
Tessel: The End of Web Development (as we know it)Tessel: The End of Web Development (as we know it)
Tessel: The End of Web Development (as we know it)TechnicalMachine
 
Augmented reality report
Augmented reality reportAugmented reality report
Augmented reality reportSatyendra Gupta
 
Augmented reality [1]
Augmented reality [1]Augmented reality [1]
Augmented reality [1]Tylar Robison
 
augmented reality and virtual reality
augmented reality and virtual realityaugmented reality and virtual reality
augmented reality and virtual realityrajinfovision
 
Future of Cellular IoT
Future of Cellular IoTFuture of Cellular IoT
Future of Cellular IoTParticle
 
Virtual Augmented Reality Projects Research Help
Virtual Augmented Reality Projects Research HelpVirtual Augmented Reality Projects Research Help
Virtual Augmented Reality Projects Research HelpMatlab Simulation
 
The Shifting Landscape of IoT
The Shifting Landscape of IoTThe Shifting Landscape of IoT
The Shifting Landscape of IoTParticle
 
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...AI Frontiers
 
Augmented reality The future of computing
Augmented reality The future of computingAugmented reality The future of computing
Augmented reality The future of computingAbhishek Abhi
 
Future of Augmented Reality
Future of Augmented RealityFuture of Augmented Reality
Future of Augmented RealityOsamaAliMangi
 
The Internet of Things - 36th International Conference of Privacy and Data Co...
The Internet of Things - 36th International Conference of Privacy and Data Co...The Internet of Things - 36th International Conference of Privacy and Data Co...
The Internet of Things - 36th International Conference of Privacy and Data Co...Kate Carruthers
 
Augmented Reality & Applications
Augmented Reality & ApplicationsAugmented Reality & Applications
Augmented Reality & ApplicationsJishnu Pradeep
 
Introduction to Virtual and Augmented Reality
Introduction to Virtual and Augmented RealityIntroduction to Virtual and Augmented Reality
Introduction to Virtual and Augmented Realityoftanna
 

What's hot (20)

Augmented reality
Augmented realityAugmented reality
Augmented reality
 
Phare Conference - Steve Clayton, NUI
Phare Conference - Steve Clayton, NUIPhare Conference - Steve Clayton, NUI
Phare Conference - Steve Clayton, NUI
 
Virtual reality Simple and Atractive presentation
Virtual reality Simple and Atractive presentationVirtual reality Simple and Atractive presentation
Virtual reality Simple and Atractive presentation
 
Theinternetofthings pastpresentfuture-140213100418-phpapp01
Theinternetofthings pastpresentfuture-140213100418-phpapp01Theinternetofthings pastpresentfuture-140213100418-phpapp01
Theinternetofthings pastpresentfuture-140213100418-phpapp01
 
Designing for an Augmented Reality world
Designing for an Augmented Reality worldDesigning for an Augmented Reality world
Designing for an Augmented Reality world
 
3. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-13. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-1
 
Tessel: The End of Web Development (as we know it)
Tessel: The End of Web Development (as we know it)Tessel: The End of Web Development (as we know it)
Tessel: The End of Web Development (as we know it)
 
Augmented reality report
Augmented reality reportAugmented reality report
Augmented reality report
 
Augmented reality [1]
Augmented reality [1]Augmented reality [1]
Augmented reality [1]
 
augmented reality and virtual reality
augmented reality and virtual realityaugmented reality and virtual reality
augmented reality and virtual reality
 
Future of Cellular IoT
Future of Cellular IoTFuture of Cellular IoT
Future of Cellular IoT
 
Virtual Augmented Reality Projects Research Help
Virtual Augmented Reality Projects Research HelpVirtual Augmented Reality Projects Research Help
Virtual Augmented Reality Projects Research Help
 
The Shifting Landscape of IoT
The Shifting Landscape of IoTThe Shifting Landscape of IoT
The Shifting Landscape of IoT
 
upcoming technology
upcoming technology upcoming technology
upcoming technology
 
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...
Rajarshi Gupta at AI Frontiers : Security is AI’s biggest challenge, AI is Se...
 
Augmented reality The future of computing
Augmented reality The future of computingAugmented reality The future of computing
Augmented reality The future of computing
 
Future of Augmented Reality
Future of Augmented RealityFuture of Augmented Reality
Future of Augmented Reality
 
The Internet of Things - 36th International Conference of Privacy and Data Co...
The Internet of Things - 36th International Conference of Privacy and Data Co...The Internet of Things - 36th International Conference of Privacy and Data Co...
The Internet of Things - 36th International Conference of Privacy and Data Co...
 
Augmented Reality & Applications
Augmented Reality & ApplicationsAugmented Reality & Applications
Augmented Reality & Applications
 
Introduction to Virtual and Augmented Reality
Introduction to Virtual and Augmented RealityIntroduction to Virtual and Augmented Reality
Introduction to Virtual and Augmented Reality
 

Similar to Computer Vision - now working
 in over 2 Billion Web Browsers!

Open IoT Cloud Architecture, Web of Things, Shenzhen, China.
Open IoT Cloud Architecture, Web of Things, Shenzhen, China.Open IoT Cloud Architecture, Web of Things, Shenzhen, China.
Open IoT Cloud Architecture, Web of Things, Shenzhen, China.Jollen Chen
 
Augmented Reality is just a feature!
Augmented Reality is just a feature!Augmented Reality is just a feature!
Augmented Reality is just a feature!Rob Manson
 
Boosting business with WebRTC - ClueCon 2017
Boosting business with WebRTC - ClueCon 2017Boosting business with WebRTC - ClueCon 2017
Boosting business with WebRTC - ClueCon 2017Chad Hart
 
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...Intland Software GmbH
 
[workshop] The Revolutionary WebRTC
[workshop] The Revolutionary WebRTC[workshop] The Revolutionary WebRTC
[workshop] The Revolutionary WebRTCGiacomo Vacca
 
node.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehne
node.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehnenode.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehne
node.js is made for IoT - node.hh 07/16, Hamburg by Michael KuehneMichael Kuehne-Schlinkert
 
Hatii seminar 2014 - The emerging needs and the long standing issues curating...
Hatii seminar 2014 - The emerging needs and the long standing issues curating...Hatii seminar 2014 - The emerging needs and the long standing issues curating...
Hatii seminar 2014 - The emerging needs and the long standing issues curating...Ruggero Lancia
 
DIY: Computer Vision with GWT.
DIY: Computer Vision with GWT.DIY: Computer Vision with GWT.
DIY: Computer Vision with GWT.JooinK
 
DIY- computer vision with GWT
DIY- computer vision with GWTDIY- computer vision with GWT
DIY- computer vision with GWTFrancesca Tosi
 
Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial AugmentedWorldExpo
 
WebRTC From Asterisk to Headline - MoNage
WebRTC From Asterisk to Headline - MoNageWebRTC From Asterisk to Headline - MoNage
WebRTC From Asterisk to Headline - MoNageChad Hart
 
WbeRTC in IOT presented in KrankyGeek
WbeRTC in IOT presented in KrankyGeekWbeRTC in IOT presented in KrankyGeek
WbeRTC in IOT presented in KrankyGeekALTANAI BISHT
 
Hackaday ramudroid 6.5
Hackaday ramudroid 6.5Hackaday ramudroid 6.5
Hackaday ramudroid 6.5ALTANAI BISHT
 
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...“Video Activity Recognition with Limited Data for Smart Home Applications,” a...
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...Edge AI and Vision Alliance
 
IOT BASED ROBOTIC CAR USING RASPBERRY
IOT BASED ROBOTIC CAR USING RASPBERRYIOT BASED ROBOTIC CAR USING RASPBERRY
IOT BASED ROBOTIC CAR USING RASPBERRYIRJET Journal
 
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015otoyinc
 
Opera and the Open Web platform
Opera and the Open Web platformOpera and the Open Web platform
Opera and the Open Web platformAndreas Bovens
 
Minko stage3d 20130222
Minko stage3d 20130222Minko stage3d 20130222
Minko stage3d 20130222Minko3D
 

Similar to Computer Vision - now working
 in over 2 Billion Web Browsers! (20)

Open IoT Cloud Architecture, Web of Things, Shenzhen, China.
Open IoT Cloud Architecture, Web of Things, Shenzhen, China.Open IoT Cloud Architecture, Web of Things, Shenzhen, China.
Open IoT Cloud Architecture, Web of Things, Shenzhen, China.
 
Augmented Reality is just a feature!
Augmented Reality is just a feature!Augmented Reality is just a feature!
Augmented Reality is just a feature!
 
Boosting business with WebRTC - ClueCon 2017
Boosting business with WebRTC - ClueCon 2017Boosting business with WebRTC - ClueCon 2017
Boosting business with WebRTC - ClueCon 2017
 
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...
Intland Software | codeBeamer ALM: What’s in the Pipeline for the Automotive ...
 
[workshop] The Revolutionary WebRTC
[workshop] The Revolutionary WebRTC[workshop] The Revolutionary WebRTC
[workshop] The Revolutionary WebRTC
 
node.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehne
node.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehnenode.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehne
node.js is made for IoT - node.hh 07/16, Hamburg by Michael Kuehne
 
Hatii seminar 2014 - The emerging needs and the long standing issues curating...
Hatii seminar 2014 - The emerging needs and the long standing issues curating...Hatii seminar 2014 - The emerging needs and the long standing issues curating...
Hatii seminar 2014 - The emerging needs and the long standing issues curating...
 
DIY: Computer Vision with GWT.
DIY: Computer Vision with GWT.DIY: Computer Vision with GWT.
DIY: Computer Vision with GWT.
 
DIY- computer vision with GWT
DIY- computer vision with GWTDIY- computer vision with GWT
DIY- computer vision with GWT
 
Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial
 
WebRTC From Asterisk to Headline - MoNage
WebRTC From Asterisk to Headline - MoNageWebRTC From Asterisk to Headline - MoNage
WebRTC From Asterisk to Headline - MoNage
 
DevCon5 (July 2014) - Intro to WebRTC
DevCon5 (July 2014) - Intro to WebRTCDevCon5 (July 2014) - Intro to WebRTC
DevCon5 (July 2014) - Intro to WebRTC
 
WbeRTC in IOT presented in KrankyGeek
WbeRTC in IOT presented in KrankyGeekWbeRTC in IOT presented in KrankyGeek
WbeRTC in IOT presented in KrankyGeek
 
Hackaday ramudroid 6.5
Hackaday ramudroid 6.5Hackaday ramudroid 6.5
Hackaday ramudroid 6.5
 
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...“Video Activity Recognition with Limited Data for Smart Home Applications,” a...
“Video Activity Recognition with Limited Data for Smart Home Applications,” a...
 
IOT BASED ROBOTIC CAR USING RASPBERRY
IOT BASED ROBOTIC CAR USING RASPBERRYIOT BASED ROBOTIC CAR USING RASPBERRY
IOT BASED ROBOTIC CAR USING RASPBERRY
 
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015
OTOY Presentation - 2015 NVIDIA GPU Technology Conference - March 17 2015
 
Opera and the Open Web platform
Opera and the Open Web platformOpera and the Open Web platform
Opera and the Open Web platform
 
Minko stage3d 20130222
Minko stage3d 20130222Minko stage3d 20130222
Minko stage3d 20130222
 
UAV – Unmanned Aerial Vehicles
UAV – Unmanned Aerial VehiclesUAV – Unmanned Aerial Vehicles
UAV – Unmanned Aerial Vehicles
 

More from Rob Manson

The Power of AR & VR in Learning
The Power of AR & VR in LearningThe Power of AR & VR in Learning
The Power of AR & VR in LearningRob Manson
 
Immersive Sydney - #WebXRWeek
Immersive Sydney - #WebXRWeekImmersive Sydney - #WebXRWeek
Immersive Sydney - #WebXRWeekRob Manson
 
The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17Rob Manson
 
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the webISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the webRob Manson
 
Immersive Computing @ #YOWConnected 2017
Immersive Computing @ #YOWConnected 2017Immersive Computing @ #YOWConnected 2017
Immersive Computing @ #YOWConnected 2017Rob Manson
 
Build your own reality
Build your own realityBuild your own reality
Build your own realityRob Manson
 
Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Rob Manson
 
The future is un-Real
The future is un-RealThe future is un-Real
The future is un-RealRob Manson
 
The Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesThe Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesRob Manson
 
Introduction to AR
Introduction to ARIntroduction to AR
Introduction to ARRob Manson
 
Web Standards adoption in the AR market
Web Standards adoption in the AR marketWeb Standards adoption in the AR market
Web Standards adoption in the AR marketRob Manson
 
Now here is everywhere
Now here is everywhereNow here is everywhere
Now here is everywhereRob Manson
 
AR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingAR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingRob Manson
 
Your browser can see and hear and ...
Your browser can see and hear and ...Your browser can see and hear and ...
Your browser can see and hear and ...Rob Manson
 
Web Standards based Augmented Reality
Web Standards based Augmented RealityWeb Standards based Augmented Reality
Web Standards based Augmented RealityRob Manson
 
Is that sense-able?
Is that sense-able?Is that sense-able?
Is that sense-able?Rob Manson
 
streetARt case study for ARE2011
streetARt case study for ARE2011streetARt case study for ARE2011
streetARt case study for ARE2011Rob Manson
 
ARSyd March 2011
ARSyd March 2011ARSyd March 2011
ARSyd March 2011Rob Manson
 
Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Rob Manson
 

More from Rob Manson (20)

The Power of AR & VR in Learning
The Power of AR & VR in LearningThe Power of AR & VR in Learning
The Power of AR & VR in Learning
 
Immersive Sydney - #WebXRWeek
Immersive Sydney - #WebXRWeekImmersive Sydney - #WebXRWeek
Immersive Sydney - #WebXRWeek
 
The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17
 
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the webISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
 
Immersive Computing @ #YOWConnected 2017
Immersive Computing @ #YOWConnected 2017Immersive Computing @ #YOWConnected 2017
Immersive Computing @ #YOWConnected 2017
 
Build your own reality
Build your own realityBuild your own reality
Build your own reality
 
Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13
 
The future is un-Real
The future is un-RealThe future is un-Real
The future is un-Real
 
The Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesThe Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the masses
 
Introduction to AR
Introduction to ARIntroduction to AR
Introduction to AR
 
Web Standards adoption in the AR market
Web Standards adoption in the AR marketWeb Standards adoption in the AR market
Web Standards adoption in the AR market
 
Now here is everywhere
Now here is everywhereNow here is everywhere
Now here is everywhere
 
AR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingAR is the UI for Pervasive Computing
AR is the UI for Pervasive Computing
 
Your browser can see and hear and ...
Your browser can see and hear and ...Your browser can see and hear and ...
Your browser can see and hear and ...
 
Web Standards based Augmented Reality
Web Standards based Augmented RealityWeb Standards based Augmented Reality
Web Standards based Augmented Reality
 
Is that sense-able?
Is that sense-able?Is that sense-able?
Is that sense-able?
 
What is web3?
What is web3?What is web3?
What is web3?
 
streetARt case study for ARE2011
streetARt case study for ARE2011streetARt case study for ARE2011
streetARt case study for ARE2011
 
ARSyd March 2011
ARSyd March 2011ARSyd March 2011
ARSyd March 2011
 
Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010
 

Recently uploaded

Augmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical ProfessionalsAugmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical Professionalsthirdeyegen65
 
Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfgalfinprihardiputra0
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPTPraveenKumarThota7
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Damar Juniarto
 
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS  Clarify, Feature Store, Hyper parameter TuningAWS Overview of AWS  Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS Clarify, Feature Store, Hyper parameter TuningVarun Garg
 
Red shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's CyberspaceRed shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's Cyberspacesttyk
 
UGB INTERNETBANKING FACILITY LAUNCHED.pptx
UGB INTERNETBANKING FACILITY LAUNCHED.pptxUGB INTERNETBANKING FACILITY LAUNCHED.pptx
UGB INTERNETBANKING FACILITY LAUNCHED.pptxRitesh Sahu
 
Obstructive jaundice is a medical condition characterized by the yellowing of...
Obstructive jaundice is a medical condition characterized by the yellowing of...Obstructive jaundice is a medical condition characterized by the yellowing of...
Obstructive jaundice is a medical condition characterized by the yellowing of...ssuser7b7f4e
 
Augmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & DefenseAugmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & Defensethirdeyegen65
 

Recently uploaded (9)

Augmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical ProfessionalsAugmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical Professionals
 
Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdf
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPT
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023
 
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS  Clarify, Feature Store, Hyper parameter TuningAWS Overview of AWS  Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
 
Red shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's CyberspaceRed shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's Cyberspace
 
UGB INTERNETBANKING FACILITY LAUNCHED.pptx
UGB INTERNETBANKING FACILITY LAUNCHED.pptxUGB INTERNETBANKING FACILITY LAUNCHED.pptx
UGB INTERNETBANKING FACILITY LAUNCHED.pptx
 
Obstructive jaundice is a medical condition characterized by the yellowing of...
Obstructive jaundice is a medical condition characterized by the yellowing of...Obstructive jaundice is a medical condition characterized by the yellowing of...
Obstructive jaundice is a medical condition characterized by the yellowing of...
 
Augmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & DefenseAugmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & Defense
 

Computer Vision - now working
 in over 2 Billion Web Browsers!

  • 1. Computer Vision - now working
 in over 2 Billion Web Browsers! Rob Manson
 CEO & co-founder Sebastian Montabone
 Computer Vision Engineer Mixed Reality. In the web. On any device. https://try.awe.media
  • 3. So what is Mixed Reality? Here’s a short demo of Milgram’s Mixed Reality Continuum - all running in a browser. awe.media
  • 4. A brief/biased history of Computer Vision 1957 - Russel A. Kirsch scans first photo with a computer 1960 - Larry Roberts publishes thesis at MIT 1964 - First facial recognition system (unamed intelligence agency) 1976 - UK Police create first License Plate recognition system 1978 - David Marr proposes edge detection framework at MIT 1985 - Lockheed Martin/Carnegie Mellon create first self-driving land vehicle 1992 - Tom Caudell at Boeing coins the term Augmented Reality 1999 - Billinghurst & Kato publish/demo ARToolkit at IWAR/SIGGRAPH 2000 - Windows only alpha version of OpenCV launched at CVPR 2007 - OpenCV 1.0 released 2008 - ARToolkit ported to Flash by @saqoosha 2011 - ARToolkit ported to Javascript by Ilmari Heikkinen 2011 - FastCV/Vuforia 1.0 released 2017 - Facebook adds Computer Vision to their camera app 2017 - OpenCV in the browser demonstrated here awe.media
  • 5. How does Computer Vision
 work in the browser? awe.media camera -> gUM -> video -> canvas -> pixels -> vision algorithms
  • 6. HTMLVideoElement This is a container for decoding and presenting video streams. This brought plugin free video to the web. awe.media
  • 7. awe.media Canvas, WebGL & the ArrayBuffer The 2D Canvas gave us the ability to convert a video stream into pixel data. WebGL brought 3D Canvases with access to the GPU. But most importantly WebGL gave us ArrayBuffers
 which allowed us to access the pixel data for the first time.
  • 8. awe.media JSARToolkit In 2011 Billinghurst & Kato's ARToolkit was ported to Javascript.
  • 9. awe.media Enter WebRTC's getUserMedia() Some claim this has a latency that makes the web unusable for AR.
 But here’s the numbers running on a Pixel - the max difference is ~200ms 200-250ms - Camera stream in a native AR 350-400ms - gUM stream in a web app
  • 10. awe.media WebRTC's getUserMedia() FAST feature detection & Tigerstail in 2012
  • 13. awe.media Transpiling OpenCV This brings a more general computer vision toolkit to the web!
  • 15. awe.media But there's no gUM on iOS? For Vision based functionality we fallback to Visual Search For Location based apps we fallback to 360°/VR (like Pokemon Go with the camera off) And remember “video see thu” is not the only form of AR