SlideShare a Scribd company logo
“Say cheese....”


                                  High-Speed Single-Photon Camera
                                                         Fabrizio Guerrieri



    Advisor: Prof. Franco Zappa
    Co-advisor: Dr. Simone Tisa
    Tutor: Prof. Angelo Geraci
“Say cheese....”


                   What am I going to talk about?



   MOTIVATIONS          THE MAKING OF            FROM THE DEVICE...
     & IDEAS           THE SPAD CAMERA      ... TO THE APPLICATIONS (3)
MOTIVATIONS
          Demanding imaging applications require

     Extreme sensitivity     AND high-speed
MOTIVATIONS
                Demanding imaging applications require

           Extreme sensitivity      AND high-speed
                                                            HIGH-SENSITIVITY
                                                            HIGH-SPEED
      EM-CCD
                 EB-CCD
       I-CCD
                                   RR AYS
                            PA DA
                          S
                                                 CMOS APS
Standard
CCD
IMAGER SPECIFICATIONS
   REQUIREMENT                 PROPOSED SOLUTION                     RISK
Single-Photon sensitivity            SPAD detector

      High-speed
                             Completely independent pixels
   ( > 10 kframe/s )

   High pixel number                     > 100

     Compactness            Use of HV-CMOS compatible tech

   Additional features      Global shutter, programmability...


                                                  Increasing risk:
SPAD ARRAYS

HIGH PERFORMANCE ARRAY
• Large pixel diameter
• Moderate number of pixels
• Limited by the ext. Electronics
                                      CUSTOM TECH

DENSE ARRAY
• Small pixel diameter
• Large number of pixels
• Possibility of smart pixels


                                    STANDARD CMOS TECH
ACTIVE QUENCHING CIRCUIT




 Group’s State-of-the-Art   VLQC
ARRAY ARCHITECTURE      INTEGRATED
                     QUENCHING CIRCUIT

    CMOS SPAD
     (20µm)



                                8 BIT
                              COUNTER




 GLOBAL
 SIGNALS
                          INTERNAL
                           BUFFER
                           MEMORY
ARRAY OPERATIONS
ARRAY OPERATIONS
ARRAY OPERATIONS
ARRAY OPERATIONS
PIXEL LAYOUT



 20 μm

                        100 μm




               100 μm
SPAD ARRAYS




VLQC   SMART PIXEL




                      LINEAR 32x1 ARRAY                32x32 SPAD IMAGER
                32 counting and timing channels   1,024 parallel counting channels
                     Single-photon sensitivity       Single-photon sensitivity
                       Up to 312.5 kframe/s             Up to 100 kframe/s
SPAD IMAGER




• 1024 parallel channels   • Programmable to read-out any pixel sub-
• Global shutter             portion to increase max frame-rate
• Up to 100 kframe/s
SPAD IMAGER
Experimental measurements




                 Up to 45% Single-Photon Det. Efficiency
                 75% DCR < 4 kcps at room temperature
                     Negligible crosstalk probability
IMAGER SPECIFICATIONS

     REQUIREMENT                IMPLEMENTED SOLUTION
  Single-Photon sensitivity          CMOS SPAD detector             ✔
        High-speed            “Smart” pixel comprising everything
     ( > 10 kframe/s )           necessary to count photons
                                                                    ✔
     High pixel number               32x32 CMOS imager              ✔
       Compactness               100x100 μm pixel dimension         ✔
     Additional features       Global shutter, programmability...   ✔
SPAD CAMERA
SPAD CAMERA




              • FPGA-based high-speed electronics
              • Requires only USB cable to work: Plug’n’Play
              • Developed cross-platform software
SPAD CAMERA




                            770 μs

• Easy to use
• 40 kframe/s
• Low light level at such
  a high speed
SUB-RAYLEIGH IMAGING @ MIT
Conventional imaging with non-diffraction limited optics
SUB-RAYLEIGH IMAGING @ MIT
Conventional imaging with diffraction limited optics




                                         Rayleigh bound
                                              Stripe size
SUB-RAYLEIGH IMAGING @ MIT
    Setup modi cations to apply the Sub-Rayleight technique

                                                                               2
1
   Movable
                                                                   N-Photon
   focused
                                                                   Detection
laser beam




                                                               ?
                                            Rayleigh bound
                                                 Stripe size
SUB-RAYLEIGH IMAGING @ MIT
 Sub-Rayleigh imaging with diffraction limited optics




   Movable
                                                           N-Photon
   focused
                                                           Detection
laser beam




                                        Rayleigh bound
                                             Stripe size
                                    Sub-Rayleigh bound
SUB-RAYLEIGH IMAGING @ MIT




     Good optics                  Bad optics                  Bad optics
          +                           +                           +
 Conventional imaging        Conventional imaging        Sub-Rayleigh imaging

               Imaging beyond the Rayleigh limit is possible by
               •Scanning the object by a focused light spot
               •Employing N-Photon detection strategy
               Improvement goes as about the square root of N
HIGH THROUGHPUT FCS @ UCLA
                       Fluorescent analyte ows or diffuses
                       through a small excitation volume
                       emitting uorescence bursts

                       Fluorescence Correlation Spectroscopy
                       (FCS) analyses the uorescence intensity
                        uctuations using temporal
                       autocorrelation
HIGH THROUGHPUT FCS @ UCLA
 To work well only     PROBLEM!                       SOLUTION!
                                     Need faster
one particle at time      Long                     Multi-spot parallel
                                     acquisition
  should enter the     acquisition                  FCS acquisitions
                                     of FCS data
 excitation volume       times!
HIGH THROUGHPUT FCS @ UCLA
 To work well only       PROBLEM!                            SOLUTION!
                                         Need faster
one particle at time        Long                          Multi-spot parallel
                                         acquisition
  should enter the       acquisition                       FCS acquisitions
                                         of FCS data
 excitation volume         times!


            A very sensitive and high-speed device is required!
                    SPAD arrays as enabling technology
HIGH THROUGHPUT FCS @ UCLA




LCOS-SLM and SPAD array
  enabling technologies
HIGH THROUGHPUT FCS @ UCLA




         8x8 ACF with rescaling
          100 nm beads in H2O

 Curves overlap and can be tted
3D IMAGING
    Indirect-ToF
    •Modulated light illuminates
    the scene
    •A very sensitive detector
    measure the re ected light
    •Depth information can be
    extracted calculating the
    waveform phase shift:

              Δt
            L= c
              2



€
3D IMAGING
                       How did a 2D camera become “3D capable”?




Light source + driver + waveform generator + new FPGA rmware
3D IMAGING
             Depth resolution:
             3 – 9 mm
             Scene depth:
             30 cm
             Measurement time:
             10 s




               Good results but
              need to speed the
              acquisition up to
              get movie-like 3D
                  imaging
CONCLUSIONS
                                     Group SoA




                                 My work




VLQC                                                       3D
        Pixel                                            Imaging
                                                   FCS
                32x32    SPAD       Sub-Rayleigh
                Array   Camera        Imaging
CONCLUSIONS
          Novel SPAD quenching circuit
          •Small footprint
          •Small parasitic capacitance
          •Compatible with CMOS SPAD technology
          •Reduced afterpulsing and good timing




VLQC                                                                     3D
        Pixel                                                          Imaging
                                                                 FCS
                      32x32            SPAD       Sub-Rayleigh
                      Array           Camera        Imaging
CONCLUSIONS
          Smart pixel architecture
          •20-μm CMOS SPAD detector
          •Front-end electronics (VLQC)
          •Counting and buffer digital logic




VLQC                                                                     3D
        Pixel                                                          Imaging
                                                                 FCS
                        32x32             SPAD    Sub-Rayleigh
                        Array            Camera     Imaging
CONCLUSIONS
          32x32 CMOS SPAD imager
          •1,024 indipendent photon counting channels
          •Single-photon sensitivity
          •Up to 100 kframe/s




VLQC                                                                       3D
        Pixel                                                            Imaging
                                                                   FCS
                       32x32            SPAD        Sub-Rayleigh
                       Array           Camera         Imaging
CONCLUSIONS
          SPAD camera
          •High-speed digital FPGA-based system electronics
          •Plug’n’play device. Power supplies from USB
          •Cross-platform user-friendly user interface
          •Optics




VLQC                                                                        3D
        Pixel                                                             Imaging
                                                                    FCS
                       32x32             SPAD        Sub-Rayleigh
                       Array            Camera         Imaging
CONCLUSIONS
          Sub-Rayleigh imaging @
          •Experimentally demonstrated and developed novel imaging technique
          •Full project responsability
          •SPAD camera as enabling technology




VLQC                                                                             3D
        Pixel                                                                  Imaging
                                                                     FCS
                       32x32            SPAD        Sub-Rayleigh
                       Array           Camera         Imaging
CONCLUSIONS
          Fluorescence Correlation Spectroscopy @
          •Proof of concept for high-troughput FCS on 1,024 parallel channels
          •Customization of SPAD camera for FCS
          •Promising preliminary experimental results




VLQC                                                                              3D
        Pixel                                                                   Imaging
                                                                          FCS
                        32x32             SPAD         Sub-Rayleigh
                        Array            Camera          Imaging
CONCLUSIONS
          3D imaging @ Polimi
          •Developed and conceived technique to use SPAD camera in 3D imaging
          •Very good preliminary experiments




VLQC                                                                              3D
        Pixel                                                                   Imaging
                                                                      FCS
                       32x32            SPAD        Sub-Rayleigh
                       Array           Camera         Imaging
PHD FACTS
Achievements/Awards
                                             PhD doctoral school
• Physical Review Letters as rst author      Courses’ grade: all A (8 courses)
  (IF=7.33)                                  Attended extra non-mandatory courses
• Progetto Rocca fellowship
                                             Publications
• My research helped the group to submit
  and win an European grant.                 Total papers: 29
                                             Conference talks: 6
• Laser Focus World Award
  “Commendation for excellence in                      Other
  technical communications”                        Magazine
• Co-author of 2 invited conference papers   Conf. co-author
• ESSDERC08: special congratulation by       Conf. 1st author
  conference committee
                                                     Journal
• PhDay 2008 1° year student award
                                                                0   3   5   8   10

More Related Content

What's hot

rfid based traffic control system by using gsm
rfid based traffic control system by using gsmrfid based traffic control system by using gsm
rfid based traffic control system by using gsm
ramesh chatty
 
Resnet
ResnetResnet
A thesis presentation on pothole detection
A thesis presentation on pothole detectionA thesis presentation on pothole detection
A thesis presentation on pothole detection
PrimeAsia University
 
Role of OpManager in event and fault management
Role of OpManager in event and fault managementRole of OpManager in event and fault management
Role of OpManager in event and fault management
ManageEngine
 
Network Management Fundamentals
Network Management FundamentalsNetwork Management Fundamentals
Network Management Fundamentals
SolarWinds
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-concept
Qualcomm Research
 
NVIDIA vGPU - Introduction to NVIDIA Virtual GPU
NVIDIA vGPU - Introduction to NVIDIA Virtual GPUNVIDIA vGPU - Introduction to NVIDIA Virtual GPU
NVIDIA vGPU - Introduction to NVIDIA Virtual GPU
Lee Bushen
 
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air UpdatesRed Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software
 
Cctv
CctvCctv
Smart street light system
Smart street light systemSmart street light system
Smart street light system
ChethanMp7
 
FPD-Link III Serializers & Deserializers
FPD-Link III Serializers & DeserializersFPD-Link III Serializers & Deserializers
FPD-Link III Serializers & Deserializers
Premier Farnell
 
RISC-V & SoC Architectural Exploration for AI and ML Accelerators
RISC-V & SoC Architectural Exploration for AI and ML AcceleratorsRISC-V & SoC Architectural Exploration for AI and ML Accelerators
RISC-V & SoC Architectural Exploration for AI and ML Accelerators
RISC-V International
 
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
Yole Developpement
 
Jetson AGX Xavier and the New Era of Autonomous Machines
Jetson AGX Xavier and the New Era of Autonomous MachinesJetson AGX Xavier and the New Era of Autonomous Machines
Jetson AGX Xavier and the New Era of Autonomous Machines
Dustin Franklin
 
Feature Matching using SIFT algorithm
Feature Matching using SIFT algorithmFeature Matching using SIFT algorithm
Feature Matching using SIFT algorithm
Sajid Pareeth
 
Video Classification: Human Action Recognition on HMDB-51 dataset
Video Classification: Human Action Recognition on HMDB-51 datasetVideo Classification: Human Action Recognition on HMDB-51 dataset
Video Classification: Human Action Recognition on HMDB-51 dataset
Giorgio Carbone
 
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI InferencingInnovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Rebekah Rodriguez
 
Building on TAP sync resiliency for the cloud
Building on TAP sync resiliency for the cloud Building on TAP sync resiliency for the cloud
Building on TAP sync resiliency for the cloud
Adtran
 
"Understanding Automotive Radar: Present and Future," a Presentation from NXP...
"Understanding Automotive Radar: Present and Future," a Presentation from NXP..."Understanding Automotive Radar: Present and Future," a Presentation from NXP...
"Understanding Automotive Radar: Present and Future," a Presentation from NXP...
Edge AI and Vision Alliance
 
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDSAutomotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
IOSR Journals
 

What's hot (20)

rfid based traffic control system by using gsm
rfid based traffic control system by using gsmrfid based traffic control system by using gsm
rfid based traffic control system by using gsm
 
Resnet
ResnetResnet
Resnet
 
A thesis presentation on pothole detection
A thesis presentation on pothole detectionA thesis presentation on pothole detection
A thesis presentation on pothole detection
 
Role of OpManager in event and fault management
Role of OpManager in event and fault managementRole of OpManager in event and fault management
Role of OpManager in event and fault management
 
Network Management Fundamentals
Network Management FundamentalsNetwork Management Fundamentals
Network Management Fundamentals
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-concept
 
NVIDIA vGPU - Introduction to NVIDIA Virtual GPU
NVIDIA vGPU - Introduction to NVIDIA Virtual GPUNVIDIA vGPU - Introduction to NVIDIA Virtual GPU
NVIDIA vGPU - Introduction to NVIDIA Virtual GPU
 
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air UpdatesRed Bend Software: Optimizing the User Experience with Over-the-Air Updates
Red Bend Software: Optimizing the User Experience with Over-the-Air Updates
 
Cctv
CctvCctv
Cctv
 
Smart street light system
Smart street light systemSmart street light system
Smart street light system
 
FPD-Link III Serializers & Deserializers
FPD-Link III Serializers & DeserializersFPD-Link III Serializers & Deserializers
FPD-Link III Serializers & Deserializers
 
RISC-V & SoC Architectural Exploration for AI and ML Accelerators
RISC-V & SoC Architectural Exploration for AI and ML AcceleratorsRISC-V & SoC Architectural Exploration for AI and ML Accelerators
RISC-V & SoC Architectural Exploration for AI and ML Accelerators
 
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
Yole Intel RealSense 3D camera module and STM IR laser 2015 teardown reverse ...
 
Jetson AGX Xavier and the New Era of Autonomous Machines
Jetson AGX Xavier and the New Era of Autonomous MachinesJetson AGX Xavier and the New Era of Autonomous Machines
Jetson AGX Xavier and the New Era of Autonomous Machines
 
Feature Matching using SIFT algorithm
Feature Matching using SIFT algorithmFeature Matching using SIFT algorithm
Feature Matching using SIFT algorithm
 
Video Classification: Human Action Recognition on HMDB-51 dataset
Video Classification: Human Action Recognition on HMDB-51 datasetVideo Classification: Human Action Recognition on HMDB-51 dataset
Video Classification: Human Action Recognition on HMDB-51 dataset
 
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI InferencingInnovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
 
Building on TAP sync resiliency for the cloud
Building on TAP sync resiliency for the cloud Building on TAP sync resiliency for the cloud
Building on TAP sync resiliency for the cloud
 
"Understanding Automotive Radar: Present and Future," a Presentation from NXP...
"Understanding Automotive Radar: Present and Future," a Presentation from NXP..."Understanding Automotive Radar: Present and Future," a Presentation from NXP...
"Understanding Automotive Radar: Present and Future," a Presentation from NXP...
 
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDSAutomotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
Automotive Diagnostics Communication Protocols AnalysisKWP2000, CAN, and UDS
 

Similar to High-Speed Single-Photon SPAD Camera

Detectors for light microscopy
Detectors for light microscopyDetectors for light microscopy
Detectors for light microscopy
andortech
 
Nityanand gopalika digital radiography performance study
Nityanand gopalika   digital radiography performance studyNityanand gopalika   digital radiography performance study
Nityanand gopalika digital radiography performance study
Nityanand Gopalika
 
Digital Imaging
Digital ImagingDigital Imaging
Defying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital ConversionDefying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital Conversion
Distinguished Lecturer Series - Leon The Mathematician
 
compiter radiography and digital radiography
compiter radiography and digital radiography compiter radiography and digital radiography
compiter radiography and digital radiography
Unaiz Musthafa
 
Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01
Camera Culture Group, MIT Media Lab
 
Raskar Mar09 Nesosa
Raskar Mar09 NesosaRaskar Mar09 Nesosa
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
Matt Hirsch - MIT Media Lab
 
J Fernandes Hst 2009
J Fernandes Hst 2009J Fernandes Hst 2009
J Fernandes Hst 2009
jlfernandes85
 
Nanonics - Raman MultiProbe
Nanonics - Raman MultiProbeNanonics - Raman MultiProbe
Nanonics - Raman MultiProbe
Nanonics
 
20120927 台科大 oct原理及在眼科的應用 (1)
20120927 台科大 oct原理及在眼科的應用 (1)20120927 台科大 oct原理及在眼科的應用 (1)
20120927 台科大 oct原理及在眼科的應用 (1)
doc30845
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
DrAbhishek Gowda
 
Fujifilm - e2v L3 Vision
Fujifilm - e2v L3 VisionFujifilm - e2v L3 Vision
Fujifilm - e2v L3 Vision
Bernard Genoud
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
Camera Culture Group, MIT Media Lab
 
13.45 o15 n winch
13.45 o15 n winch13.45 o15 n winch
13.45 o15 n winch
NZIP
 
DIGITAL RADIOGRAPHY-SABBU KHATOON .pptx
DIGITAL RADIOGRAPHY-SABBU KHATOON  .pptxDIGITAL RADIOGRAPHY-SABBU KHATOON  .pptx
DIGITAL RADIOGRAPHY-SABBU KHATOON .pptx
Sabbu Khatoon
 
Computed radiography &digital radiography
Computed radiography &digital radiographyComputed radiography &digital radiography
Computed radiography &digital radiography
Rad Tech
 
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
npinto
 
Sparse and Redundant Representations: Theory and Applications
Sparse and Redundant Representations: Theory and ApplicationsSparse and Redundant Representations: Theory and Applications
Sparse and Redundant Representations: Theory and Applications
Distinguished Lecturer Series - Leon The Mathematician
 
CR & DR
CR & DRCR & DR

Similar to High-Speed Single-Photon SPAD Camera (20)

Detectors for light microscopy
Detectors for light microscopyDetectors for light microscopy
Detectors for light microscopy
 
Nityanand gopalika digital radiography performance study
Nityanand gopalika   digital radiography performance studyNityanand gopalika   digital radiography performance study
Nityanand gopalika digital radiography performance study
 
Digital Imaging
Digital ImagingDigital Imaging
Digital Imaging
 
Defying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital ConversionDefying Nyquist in Analog to Digital Conversion
Defying Nyquist in Analog to Digital Conversion
 
compiter radiography and digital radiography
compiter radiography and digital radiography compiter radiography and digital radiography
compiter radiography and digital radiography
 
Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01
 
Raskar Mar09 Nesosa
Raskar Mar09 NesosaRaskar Mar09 Nesosa
Raskar Mar09 Nesosa
 
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
>A Switchable Light Field Camera Architecture with Angle SEnsitive Pixels and...
 
J Fernandes Hst 2009
J Fernandes Hst 2009J Fernandes Hst 2009
J Fernandes Hst 2009
 
Nanonics - Raman MultiProbe
Nanonics - Raman MultiProbeNanonics - Raman MultiProbe
Nanonics - Raman MultiProbe
 
20120927 台科大 oct原理及在眼科的應用 (1)
20120927 台科大 oct原理及在眼科的應用 (1)20120927 台科大 oct原理及在眼科的應用 (1)
20120927 台科大 oct原理及在眼科的應用 (1)
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
 
Fujifilm - e2v L3 Vision
Fujifilm - e2v L3 VisionFujifilm - e2v L3 Vision
Fujifilm - e2v L3 Vision
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
13.45 o15 n winch
13.45 o15 n winch13.45 o15 n winch
13.45 o15 n winch
 
DIGITAL RADIOGRAPHY-SABBU KHATOON .pptx
DIGITAL RADIOGRAPHY-SABBU KHATOON  .pptxDIGITAL RADIOGRAPHY-SABBU KHATOON  .pptx
DIGITAL RADIOGRAPHY-SABBU KHATOON .pptx
 
Computed radiography &digital radiography
Computed radiography &digital radiographyComputed radiography &digital radiography
Computed radiography &digital radiography
 
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
IAP09 CUDA@MIT 6.963 - Lecture 01: High-Throughput Scientific Computing (Hans...
 
Sparse and Redundant Representations: Theory and Applications
Sparse and Redundant Representations: Theory and ApplicationsSparse and Redundant Representations: Theory and Applications
Sparse and Redundant Representations: Theory and Applications
 
CR & DR
CR & DRCR & DR
CR & DR
 

Recently uploaded

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 

Recently uploaded (20)

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 

High-Speed Single-Photon SPAD Camera

  • 1. “Say cheese....” High-Speed Single-Photon Camera Fabrizio Guerrieri Advisor: Prof. Franco Zappa Co-advisor: Dr. Simone Tisa Tutor: Prof. Angelo Geraci
  • 2. “Say cheese....” What am I going to talk about? MOTIVATIONS THE MAKING OF FROM THE DEVICE... & IDEAS THE SPAD CAMERA ... TO THE APPLICATIONS (3)
  • 3. MOTIVATIONS Demanding imaging applications require Extreme sensitivity AND high-speed
  • 4. MOTIVATIONS Demanding imaging applications require Extreme sensitivity AND high-speed HIGH-SENSITIVITY HIGH-SPEED EM-CCD EB-CCD I-CCD RR AYS PA DA S CMOS APS Standard CCD
  • 5. IMAGER SPECIFICATIONS REQUIREMENT PROPOSED SOLUTION RISK Single-Photon sensitivity SPAD detector High-speed Completely independent pixels ( > 10 kframe/s ) High pixel number > 100 Compactness Use of HV-CMOS compatible tech Additional features Global shutter, programmability... Increasing risk:
  • 6. SPAD ARRAYS HIGH PERFORMANCE ARRAY • Large pixel diameter • Moderate number of pixels • Limited by the ext. Electronics CUSTOM TECH DENSE ARRAY • Small pixel diameter • Large number of pixels • Possibility of smart pixels STANDARD CMOS TECH
  • 7. ACTIVE QUENCHING CIRCUIT Group’s State-of-the-Art VLQC
  • 8. ARRAY ARCHITECTURE INTEGRATED QUENCHING CIRCUIT CMOS SPAD (20µm) 8 BIT COUNTER GLOBAL SIGNALS INTERNAL BUFFER MEMORY
  • 13. PIXEL LAYOUT 20 μm 100 μm 100 μm
  • 14. SPAD ARRAYS VLQC SMART PIXEL LINEAR 32x1 ARRAY 32x32 SPAD IMAGER 32 counting and timing channels 1,024 parallel counting channels Single-photon sensitivity Single-photon sensitivity Up to 312.5 kframe/s Up to 100 kframe/s
  • 15. SPAD IMAGER • 1024 parallel channels • Programmable to read-out any pixel sub- • Global shutter portion to increase max frame-rate • Up to 100 kframe/s
  • 16. SPAD IMAGER Experimental measurements Up to 45% Single-Photon Det. Efficiency 75% DCR < 4 kcps at room temperature Negligible crosstalk probability
  • 17. IMAGER SPECIFICATIONS REQUIREMENT IMPLEMENTED SOLUTION Single-Photon sensitivity CMOS SPAD detector ✔ High-speed “Smart” pixel comprising everything ( > 10 kframe/s ) necessary to count photons ✔ High pixel number 32x32 CMOS imager ✔ Compactness 100x100 μm pixel dimension ✔ Additional features Global shutter, programmability... ✔
  • 19. SPAD CAMERA • FPGA-based high-speed electronics • Requires only USB cable to work: Plug’n’Play • Developed cross-platform software
  • 20. SPAD CAMERA 770 μs • Easy to use • 40 kframe/s • Low light level at such a high speed
  • 21. SUB-RAYLEIGH IMAGING @ MIT Conventional imaging with non-diffraction limited optics
  • 22. SUB-RAYLEIGH IMAGING @ MIT Conventional imaging with diffraction limited optics Rayleigh bound Stripe size
  • 23. SUB-RAYLEIGH IMAGING @ MIT Setup modi cations to apply the Sub-Rayleight technique 2 1 Movable N-Photon focused Detection laser beam ? Rayleigh bound Stripe size
  • 24. SUB-RAYLEIGH IMAGING @ MIT Sub-Rayleigh imaging with diffraction limited optics Movable N-Photon focused Detection laser beam Rayleigh bound Stripe size Sub-Rayleigh bound
  • 25. SUB-RAYLEIGH IMAGING @ MIT Good optics Bad optics Bad optics + + + Conventional imaging Conventional imaging Sub-Rayleigh imaging Imaging beyond the Rayleigh limit is possible by •Scanning the object by a focused light spot •Employing N-Photon detection strategy Improvement goes as about the square root of N
  • 26. HIGH THROUGHPUT FCS @ UCLA Fluorescent analyte ows or diffuses through a small excitation volume emitting uorescence bursts Fluorescence Correlation Spectroscopy (FCS) analyses the uorescence intensity uctuations using temporal autocorrelation
  • 27. HIGH THROUGHPUT FCS @ UCLA To work well only PROBLEM! SOLUTION! Need faster one particle at time Long Multi-spot parallel acquisition should enter the acquisition FCS acquisitions of FCS data excitation volume times!
  • 28. HIGH THROUGHPUT FCS @ UCLA To work well only PROBLEM! SOLUTION! Need faster one particle at time Long Multi-spot parallel acquisition should enter the acquisition FCS acquisitions of FCS data excitation volume times! A very sensitive and high-speed device is required! SPAD arrays as enabling technology
  • 29. HIGH THROUGHPUT FCS @ UCLA LCOS-SLM and SPAD array enabling technologies
  • 30. HIGH THROUGHPUT FCS @ UCLA 8x8 ACF with rescaling 100 nm beads in H2O Curves overlap and can be tted
  • 31. 3D IMAGING Indirect-ToF •Modulated light illuminates the scene •A very sensitive detector measure the re ected light •Depth information can be extracted calculating the waveform phase shift: Δt L= c 2 €
  • 32. 3D IMAGING How did a 2D camera become “3D capable”? Light source + driver + waveform generator + new FPGA rmware
  • 33. 3D IMAGING Depth resolution: 3 – 9 mm Scene depth: 30 cm Measurement time: 10 s Good results but need to speed the acquisition up to get movie-like 3D imaging
  • 34. CONCLUSIONS Group SoA My work VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 35. CONCLUSIONS Novel SPAD quenching circuit •Small footprint •Small parasitic capacitance •Compatible with CMOS SPAD technology •Reduced afterpulsing and good timing VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 36. CONCLUSIONS Smart pixel architecture •20-μm CMOS SPAD detector •Front-end electronics (VLQC) •Counting and buffer digital logic VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 37. CONCLUSIONS 32x32 CMOS SPAD imager •1,024 indipendent photon counting channels •Single-photon sensitivity •Up to 100 kframe/s VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 38. CONCLUSIONS SPAD camera •High-speed digital FPGA-based system electronics •Plug’n’play device. Power supplies from USB •Cross-platform user-friendly user interface •Optics VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 39. CONCLUSIONS Sub-Rayleigh imaging @ •Experimentally demonstrated and developed novel imaging technique •Full project responsability •SPAD camera as enabling technology VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 40. CONCLUSIONS Fluorescence Correlation Spectroscopy @ •Proof of concept for high-troughput FCS on 1,024 parallel channels •Customization of SPAD camera for FCS •Promising preliminary experimental results VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 41. CONCLUSIONS 3D imaging @ Polimi •Developed and conceived technique to use SPAD camera in 3D imaging •Very good preliminary experiments VLQC 3D Pixel Imaging FCS 32x32 SPAD Sub-Rayleigh Array Camera Imaging
  • 42. PHD FACTS Achievements/Awards PhD doctoral school • Physical Review Letters as rst author Courses’ grade: all A (8 courses) (IF=7.33) Attended extra non-mandatory courses • Progetto Rocca fellowship Publications • My research helped the group to submit and win an European grant. Total papers: 29 Conference talks: 6 • Laser Focus World Award “Commendation for excellence in Other technical communications” Magazine • Co-author of 2 invited conference papers Conf. co-author • ESSDERC08: special congratulation by Conf. 1st author conference committee Journal • PhDay 2008 1° year student award 0 3 5 8 10