SlideShare a Scribd company logo
1 of 14
Online Camera Calibration
Fei-Fei Zheng
Advisor: James Elder
Background (ISSUM)
Challenges
◉ Population mobility
◉ Transit and roadways
◉ Greenhouse emissions
◉ Accessibility for people with disabilities
Intelligent System for Sustainable Urban Mobility
Computer Vision
◉ Modeling
◉ Simulation
◉ Visual analysis
Background (ISSUM)
Research Themes
◉ 3D cityscape modeling
◉ Visual analysis of crowds
◉ Intelligent transportation systems
◉ Mobile augmented reality
◉ Integrated systems
Pedestrian Analysis
Video Feed
Detection, Tracking,
Pose Estimation 3D Scene
Online Camera
Calibration
Models
Virtual agents in 3D model
◉ Camera parameters
◉ OpenPose algorithm
◉ 3D models
Camera Calibration
◉ Intrinsic parameters
◉ Extrinsic parameters
◉ Distortion coefficients
Radial Distortion No Distortion
Calibrated
Original
Offline Camera Calibration
Ground
Tilt Angle
◉ Intrinsic parameters (focal length, etc)
◉ Extrinsic parameters (3D rotation, etc)
Pan-Tilt-Zoom (PTZ) Camera
Checkerboard
1. Manhattan Frame Estimation
• 3D Rotation Estimation
(Tal & Elder, ACCV 2012)
 Edge detection
 Probabilistic Hough transform
 Focal Length Estimation
Online Calibration
2. Estimate Camera Tilt from Motion without Tracking
(Elassal & Elder, CRV 2017)
 Optic flow
 Rectified speed
RectifiedOriginal
Online Calibration
a) Marathon dataset b) Optical flow field c) Scatter plot of speed
Online Calibration
60
65
70
75
80
Tilt (Cam1) Tilt (Cam2)
TILTANGLE(DEGREE)
Ground Truth Manhattan Motion
Tilt Angle Estimation
4.2
4.4
4.6
4.8
5
5.2
5.4
FL (Cam1) FL (Cam2)FOCALLENGTH(MM)
Ground Truth Manhattan
Focal Length Estimation
From 2D to 3D
Courtesy: Dr. Pio Claudio
Back-projection of L, R Ankles
OpenPose
Courtesy: Dr. Pio Claudio, Sun Park
Future Work
◉ Crowd counting
◉ Unusual activity detection
◉ Evacuation route planning
◉ Optimization of retail layouts
Credits
Special thanks to all the people who helped and worked with me
for this project:
◉ Supervisor: Professor James Elder
◉ Mentor: Dr. Pio Claudio
◉ Yiming Qian, Attila Gall, David Racchia, William Xiang, Sun Park
14
Any questions ?
You can find me at
◉ ffzheng@my.yorku.ca
Thanks!

More Related Content

Similar to Online Camer Calibration

CarSafe (MobiSys 2013)
CarSafe (MobiSys 2013)CarSafe (MobiSys 2013)
CarSafe (MobiSys 2013)
cwyou
 
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
c.choi
 
Aldridge asset and infrastrcuture mobile mapping
Aldridge asset and infrastrcuture mobile mappingAldridge asset and infrastrcuture mobile mapping
Aldridge asset and infrastrcuture mobile mapping
GeCo in the Rockies
 
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
Spark Summit
 
Video Surveillance Systems For Traffic Monitoring
Video Surveillance Systems For Traffic MonitoringVideo Surveillance Systems For Traffic Monitoring
Video Surveillance Systems For Traffic Monitoring
Meridian Media
 
4 f ballegeer - seize the real world
4   f ballegeer - seize the real world4   f ballegeer - seize the real world
4 f ballegeer - seize the real world
research4geomatica
 
Real Time Object Identification for Intelligent Video Surveillance Applications
Real Time Object Identification for Intelligent Video Surveillance ApplicationsReal Time Object Identification for Intelligent Video Surveillance Applications
Real Time Object Identification for Intelligent Video Surveillance Applications
Editor IJCATR
 
TraVis CTTHES3
TraVis CTTHES3TraVis CTTHES3
TraVis CTTHES3
Ni Aguirre
 
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
Hirokatsu Kataoka
 

Similar to Online Camer Calibration (20)

CarSafe (MobiSys 2013)
CarSafe (MobiSys 2013)CarSafe (MobiSys 2013)
CarSafe (MobiSys 2013)
 
tatacara kalibrasi Kendaraan.ppt
tatacara kalibrasi Kendaraan.ppttatacara kalibrasi Kendaraan.ppt
tatacara kalibrasi Kendaraan.ppt
 
vehicle calibration.ppt
vehicle calibration.pptvehicle calibration.ppt
vehicle calibration.ppt
 
unusualevent
unusualeventunusualevent
unusualevent
 
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
Real-time 3D Object Pose Estimation and Tracking for Natural Landmark Based V...
 
A017430110
A017430110A017430110
A017430110
 
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro..."High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
"High-resolution 3D Reconstruction on a Mobile Processor," a Presentation fro...
 
Aldridge asset and infrastrcuture mobile mapping
Aldridge asset and infrastrcuture mobile mappingAldridge asset and infrastrcuture mobile mapping
Aldridge asset and infrastrcuture mobile mapping
 
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
IoT and the Autonomous Vehicle in the Clouds: Simultaneous Localization and M...
 
Video Surveillance Systems For Traffic Monitoring
Video Surveillance Systems For Traffic MonitoringVideo Surveillance Systems For Traffic Monitoring
Video Surveillance Systems For Traffic Monitoring
 
4 f ballegeer - seize the real world
4   f ballegeer - seize the real world4   f ballegeer - seize the real world
4 f ballegeer - seize the real world
 
Real Time Object Identification for Intelligent Video Surveillance Applications
Real Time Object Identification for Intelligent Video Surveillance ApplicationsReal Time Object Identification for Intelligent Video Surveillance Applications
Real Time Object Identification for Intelligent Video Surveillance Applications
 
IRJET- Robust and Fast Detection of Moving Vechiles in Aerial Videos usin...
IRJET-  	  Robust and Fast Detection of Moving Vechiles in Aerial Videos usin...IRJET-  	  Robust and Fast Detection of Moving Vechiles in Aerial Videos usin...
IRJET- Robust and Fast Detection of Moving Vechiles in Aerial Videos usin...
 
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 2
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 2TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 2
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 2
 
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
 
TraVis CTTHES3
TraVis CTTHES3TraVis CTTHES3
TraVis CTTHES3
 
Webinar1 darpa07
Webinar1 darpa07Webinar1 darpa07
Webinar1 darpa07
 
Networks of wearables and augmented reality for vulnerable user protection
Networks of wearables and augmented reality for vulnerable user protectionNetworks of wearables and augmented reality for vulnerable user protection
Networks of wearables and augmented reality for vulnerable user protection
 
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
【ITSC2015】Fine-grained Walking Activity Recognition via Driving Recorder Dataset
 
Computer Vision
Computer VisionComputer Vision
Computer Vision
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

Online Camer Calibration

  • 1. Online Camera Calibration Fei-Fei Zheng Advisor: James Elder
  • 2. Background (ISSUM) Challenges ◉ Population mobility ◉ Transit and roadways ◉ Greenhouse emissions ◉ Accessibility for people with disabilities Intelligent System for Sustainable Urban Mobility Computer Vision ◉ Modeling ◉ Simulation ◉ Visual analysis
  • 3. Background (ISSUM) Research Themes ◉ 3D cityscape modeling ◉ Visual analysis of crowds ◉ Intelligent transportation systems ◉ Mobile augmented reality ◉ Integrated systems
  • 4. Pedestrian Analysis Video Feed Detection, Tracking, Pose Estimation 3D Scene Online Camera Calibration Models Virtual agents in 3D model ◉ Camera parameters ◉ OpenPose algorithm ◉ 3D models
  • 5. Camera Calibration ◉ Intrinsic parameters ◉ Extrinsic parameters ◉ Distortion coefficients Radial Distortion No Distortion Calibrated Original
  • 6. Offline Camera Calibration Ground Tilt Angle ◉ Intrinsic parameters (focal length, etc) ◉ Extrinsic parameters (3D rotation, etc) Pan-Tilt-Zoom (PTZ) Camera Checkerboard
  • 7. 1. Manhattan Frame Estimation • 3D Rotation Estimation (Tal & Elder, ACCV 2012)  Edge detection  Probabilistic Hough transform  Focal Length Estimation Online Calibration
  • 8. 2. Estimate Camera Tilt from Motion without Tracking (Elassal & Elder, CRV 2017)  Optic flow  Rectified speed RectifiedOriginal Online Calibration a) Marathon dataset b) Optical flow field c) Scatter plot of speed
  • 9. Online Calibration 60 65 70 75 80 Tilt (Cam1) Tilt (Cam2) TILTANGLE(DEGREE) Ground Truth Manhattan Motion Tilt Angle Estimation 4.2 4.4 4.6 4.8 5 5.2 5.4 FL (Cam1) FL (Cam2)FOCALLENGTH(MM) Ground Truth Manhattan Focal Length Estimation
  • 10. From 2D to 3D Courtesy: Dr. Pio Claudio Back-projection of L, R Ankles OpenPose
  • 11. Courtesy: Dr. Pio Claudio, Sun Park
  • 12. Future Work ◉ Crowd counting ◉ Unusual activity detection ◉ Evacuation route planning ◉ Optimization of retail layouts
  • 13. Credits Special thanks to all the people who helped and worked with me for this project: ◉ Supervisor: Professor James Elder ◉ Mentor: Dr. Pio Claudio ◉ Yiming Qian, Attila Gall, David Racchia, William Xiang, Sun Park
  • 14. 14 Any questions ? You can find me at ◉ ffzheng@my.yorku.ca Thanks!