SlideShare a Scribd company logo
1 of 91
Download to read offline
Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Innovating for Billions
Ramesh Raskar
Associate Professor
MIT Media Lab
Slit Lamp for
Cataracts
4
Slit Lamp Exam Retinal Scan
Retinal
Scan
Phoropter
Next 5 Billion
Emerging Interfaces
Emerging Worlds
Pamplona, Mohan, Oliveira, Raskar SIGGRAPH 2010
eyeNETRA:
Glasses and Cataract
Shack-Hartmann WS
Wavefront aberrometer
Refraction Map using Wavefront Sensor
300+ DPI LCDs
Shack-Hartmann Wavefront Sensor
Lase
r
Sensor
10
Microlen
s Array
Planar
Wavefront
Shack & Platt 1971
Liang et al 1994
David Williams et al, Rochester
Spot Diagram
Lase
r
Sensor
Displacement =
Local Slope
of the Wavefront
Spot Diagram
Shack-Hartmann Wavefront Sensor
Shack & Platt 1971
Liang et al 1994
David Williams et al, Rochester
NETRA = Inverse of Shack-Hartmann
12
Spot Diagram on LCD
Cell
Phone
Displa
y
Eye
Piece
Shack-Hartmann ~ Augmented Lightfields
Oh, Raskar, Barbastathis 2009: Augmented Light Field
NETRA = Inverse of Shack-Hartmann
13
Eye
Piece
Shack-Hartmann ~ Augmented Lightfields
Oh, Raskar, Barbastathis 2009: Augmented Light Field
Spot Diagram
on LCD
CellPhone
LCD
14
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront
sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived
15
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived
16
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived
17
Kenya
Thermometer for Eye
India
Brazil
EyeSelfie,
Swedish et al
SIGGRAPH 2015
MIT Media Lab
Next 5 Billion
Rethinking Engineering Design Execution
LVPEI@ Hyderabad
Doctor Instrument Patient
IA > AI
Intelligence
Amplification
Artificial
Intelligence
Health and Wellness Interfaces
Saving
Lives
Markets Partners
Kadambi, Gupta et al
F. Huang, G. Wetzstein, B. Barsky, R. Raskar, Siggraph 2014
Pre-corrected
Images on
Lightfield Display Siggraph 2012
Siggraph 2014
Read a book without opening pages using THz
Read a book without opening pages using THz
Sanchez, Heshmat, Reza, Romberg, Raskar 2015
Zensei: Bio Impendance
Casual Indentification
Sato, Puri, Ivan
?
Receiver/
Transmitte
r
TX
RX1
RX2
RX3
RX4
Chervat, McCullum, Feignin, Raskar 2015, NATURE SciRep 2015
See Through Walls, NATURE SciRep 2015
Demo: Rflow, Bedri et al
FLIM
Satat et al. Nature Comm 2015
Bhandari et al. 2015
Pratik Shah, Hyunsung Park
Hospitals Schools
Food Transactions
Here There Together
Kumbh Mela: 30M Visitors 30 Days
Health
Food Transport
Housing Payments
Civic
Next: Jan 24-30, 2016
Crowds from Cell Tower Data
Data
Things
Citizens
Emerging Worlds
RameshRaskar
Alex(Sandy)Pentland
KentLarson
EthanZuckerman
IyadRahwan
CesarHidalgo
uist@
Emerging Interfaces
Emerging Worlds
Publish Demo Deploy
Pencil + Cassettes
Photo of women and weighing scale
Entrepreneur
Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Innovating for Billions
IA > AI
END
neXt
• What will a camera/display look like in 20 years?
• How will the next billion cameras change the social culture?
• How can we augment the camera to support best ‘image search’?
• How will portable health diagnostics impact healthcare?
• Will we live mostly in virtual/augmented reality, telepresent?
– TiVo for life?
• How will ultra-high-speed/resolution imaging change us?
• How can we improve ‘trust’ in imaging?
• Can we print anything .. Cars, food, .. babies ..
– (what will make Amazon obsolete)
• What are the opportunities in pervasive recording?
– e.g. GoogleEarth Live
• What will be in Photoshop2030?
• What is the future of movie-making, news reporting, sports viewing?
Camera in
20 years
Photoshop
2032
Pervasive
Recording
Movies and
News
Trust and
Social Stability
Health
Diagnostics
Augmented
Reality
3D
Displays
Print
Anything
Saving
Lives
Markets Partners
DOPS, DAPS and DIPS
Digital Opportunities for Physical Systems
Digital Applications for Physical Systems
Digital Interfaces for Physical Systems
Jesse Schell
Comfort
Excitement
Solo
Multi-year
Team
Swift
Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Ramesh Raskar
Asso. Professor
MIT Media Lab
What is
Siggraph NEXT
Geometry Rendering Animation
CAD
Imaging
Movies Games Photography
???
G R A I
Games/Movies
ML
SP
Optics
Audio
Graph
Cuts
…
G R A I
Games/Movies
'Does this work contribute TO Siggraph techniques’
ML
SP
Optics
Audio
Graph
Cuts
…
G R A I
Games/Movies
?
'Does this work contribute Siggraph techniques TO ..’
New
Fabrication, VR, Displays, Cameras, Perception, …
Emerging
Health, Drones, Transport, Materials, Food, Energy, …
NEXT
Speakers’ key challenges + visual computing can solve

More Related Content

Viewers also liked

Internet2 Bio IT 2016 v2
Internet2 Bio IT 2016 v2Internet2 Bio IT 2016 v2
Internet2 Bio IT 2016 v2
Dan Taylor
 

Viewers also liked (20)

Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)
 
Google Glass Breakdown
Google Glass BreakdownGoogle Glass Breakdown
Google Glass Breakdown
 
Multiview Imaging HW Overview
Multiview Imaging HW OverviewMultiview Imaging HW Overview
Multiview Imaging HW Overview
 
Stereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt HirschStereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt Hirsch
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Google Glass Overview
Google Glass OverviewGoogle Glass Overview
Google Glass Overview
 
Kinect Tutorial
Kinect Tutorial Kinect Tutorial
Kinect Tutorial
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
Light Field Photography Introduction
Light Field Photography IntroductionLight Field Photography Introduction
Light Field Photography Introduction
 
Introduction to Photography
Introduction to PhotographyIntroduction to Photography
Introduction to Photography
 
Time of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael WhyteTime of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael Whyte
 
Developing "True HDR" for the iPhone
Developing "True HDR" for the iPhoneDeveloping "True HDR" for the iPhone
Developing "True HDR" for the iPhone
 
Introduction to Light Fields
Introduction to Light FieldsIntroduction to Light Fields
Introduction to Light Fields
 
Raskar TEDMED 2013
Raskar TEDMED 2013Raskar TEDMED 2013
Raskar TEDMED 2013
 
Computer Vision Introduction
Computer Vision IntroductionComputer Vision Introduction
Computer Vision Introduction
 
Effective ansible
Effective ansibleEffective ansible
Effective ansible
 
Role of Amyloid Burden in cognitive decline
Role of Amyloid Burden in cognitive decline Role of Amyloid Burden in cognitive decline
Role of Amyloid Burden in cognitive decline
 
Internet2 Bio IT 2016 v2
Internet2 Bio IT 2016 v2Internet2 Bio IT 2016 v2
Internet2 Bio IT 2016 v2
 
re:Invent 2013-foster-madduri
re:Invent 2013-foster-maddurire:Invent 2013-foster-madduri
re:Invent 2013-foster-madduri
 

Similar to Raskar UIST Keynote 2015 November

"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey..."Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
Edge AI and Vision Alliance
 
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian ResponseOpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
chippy
 
Abracadabra Robotics Pitch
Abracadabra Robotics PitchAbracadabra Robotics Pitch
Abracadabra Robotics Pitch
Marina Fridin
 
C Dot Pp Tfinal 14 09 09 Cbc
C Dot Pp Tfinal 14 09 09 CbcC Dot Pp Tfinal 14 09 09 Cbc
C Dot Pp Tfinal 14 09 09 Cbc
Varun Chandra
 

Similar to Raskar UIST Keynote 2015 November (20)

Before your immortality!
Before your immortality!Before your immortality!
Before your immortality!
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Lost Decade of Computational Photography
Lost Decade of Computational PhotographyLost Decade of Computational Photography
Lost Decade of Computational Photography
 
The Connected World - A Future of Possibilities
The Connected World - A Future of Possibilities The Connected World - A Future of Possibilities
The Connected World - A Future of Possibilities
 
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey..."Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
"Making the Invisible Visible: Within Our Bodies, the World Around Us and Bey...
 
8. City Science: Urban Big Data and New Urban Systems
8. City Science: Urban Big Data and New Urban Systems8. City Science: Urban Big Data and New Urban Systems
8. City Science: Urban Big Data and New Urban Systems
 
Ramesh Raskar (MIT Media Lab): The Unspoken Challenges of AR & VR
Ramesh Raskar (MIT Media Lab): The Unspoken Challenges of AR & VRRamesh Raskar (MIT Media Lab): The Unspoken Challenges of AR & VR
Ramesh Raskar (MIT Media Lab): The Unspoken Challenges of AR & VR
 
The 10 High Tech Sensor Solution Providers
The 10 High Tech Sensor Solution ProvidersThe 10 High Tech Sensor Solution Providers
The 10 High Tech Sensor Solution Providers
 
015 Leadership Essays For College Essay Example Ad
015 Leadership Essays For College Essay Example Ad015 Leadership Essays For College Essay Example Ad
015 Leadership Essays For College Essay Example Ad
 
English PPT.pptx
English PPT.pptxEnglish PPT.pptx
English PPT.pptx
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian ResponseOpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
OpenStreetMap Using, Tools, Services & Hows its changed Humanitarian Response
 
Abracadabra Robotics Pitch
Abracadabra Robotics PitchAbracadabra Robotics Pitch
Abracadabra Robotics Pitch
 
Four Disruptive Trends for the Next Decade
Four Disruptive Trends for the Next DecadeFour Disruptive Trends for the Next Decade
Four Disruptive Trends for the Next Decade
 
Approach the future of cities by the singularity of technologies !
Approach the future of cities by the singularity of technologies !Approach the future of cities by the singularity of technologies !
Approach the future of cities by the singularity of technologies !
 
Approach the future of cities by the singularity of technologies !
Approach the future of cities by the singularity of technologies !Approach the future of cities by the singularity of technologies !
Approach the future of cities by the singularity of technologies !
 
Tish Shute (Huawei): The Age of Light: From an Electronic to a Photonic Society
Tish Shute (Huawei): The Age of Light: From an Electronic to a Photonic SocietyTish Shute (Huawei): The Age of Light: From an Electronic to a Photonic Society
Tish Shute (Huawei): The Age of Light: From an Electronic to a Photonic Society
 
Raskar Next Billion Cameras Siggraph 2009
Raskar Next Billion Cameras Siggraph 2009Raskar Next Billion Cameras Siggraph 2009
Raskar Next Billion Cameras Siggraph 2009
 
C Dot Pp Tfinal 14 09 09 Cbc
C Dot Pp Tfinal 14 09 09 CbcC Dot Pp Tfinal 14 09 09 Cbc
C Dot Pp Tfinal 14 09 09 Cbc
 

More from Camera Culture Group, MIT Media Lab

God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
Camera Culture Group, MIT Media Lab
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Camera Culture Group, MIT Media Lab
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
Camera Culture Group, MIT Media Lab
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Camera Culture Group, MIT Media Lab
 

More from Camera Culture Group, MIT Media Lab (7)

Raskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award TalkRaskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award Talk
 
Covid Safe Paths
Covid Safe PathsCovid Safe Paths
Covid Safe Paths
 
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
 
Raskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis GuidanceRaskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis Guidance
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

Raskar UIST Keynote 2015 November