Summer research project that include evaluate two online camera calibration algorithms and use the algorithm with better test result to perform back-projection and geo-location for pedestrian to be virtualized in 3D model.
2. Background (ISSUM)
Challenges
◉ Population mobility
◉ Transit and roadways
◉ Greenhouse emissions
◉ Accessibility for people with disabilities
Intelligent System for Sustainable Urban Mobility
Computer Vision
◉ Modeling
◉ Simulation
◉ Visual analysis
3. Background (ISSUM)
Research Themes
◉ 3D cityscape modeling
◉ Visual analysis of crowds
◉ Intelligent transportation systems
◉ Mobile augmented reality
◉ Integrated systems
4. Pedestrian Analysis
Video Feed
Detection, Tracking,
Pose Estimation 3D Scene
Online Camera
Calibration
Models
Virtual agents in 3D model
◉ Camera parameters
◉ OpenPose algorithm
◉ 3D models
5. Camera Calibration
◉ Intrinsic parameters
◉ Extrinsic parameters
◉ Distortion coefficients
Radial Distortion No Distortion
Calibrated
Original
8. 2. Estimate Camera Tilt from Motion without Tracking
(Elassal & Elder, CRV 2017)
Optic flow
Rectified speed
RectifiedOriginal
Online Calibration
a) Marathon dataset b) Optical flow field c) Scatter plot of speed
12. Future Work
◉ Crowd counting
◉ Unusual activity detection
◉ Evacuation route planning
◉ Optimization of retail layouts
13. Credits
Special thanks to all the people who helped and worked with me
for this project:
◉ Supervisor: Professor James Elder
◉ Mentor: Dr. Pio Claudio
◉ Yiming Qian, Attila Gall, David Racchia, William Xiang, Sun Park