Computer vision is a prominent subset of artificial intelligence that can analyse and make sense of image and video data. Dr Tian Jing, Senior Lecturer & Consultant, Artificial Intelligence Practice will expand on recent advanced computer vision developments and key use cases in the new normal, such as social distancing in surveillance, hand hygiene monitoring in healthcare and more. This talk will also demonstrate examples of practice module projects of Intelligent Sensing Systems Graduate Certificate, offered by NUS-ISS in the past semesters.
1. Stay Safe and Healthy with
Computer Vision
Dr TIAN Jing
Artificial Intelligence Practice, Institute of Systems Science
National University of Singapore
tianjing@nus.edu.sg
3. What is computer vision?
Computer vision is defined as “a subset of mainstream
artificial intelligence that deals with the science of making
computers or machines visually enabled, i.e., they can analyze
and understand an image.” So ultimately, we want to teach
the machines to see just like we do: naming objects,
identifying people, inferring 3D geometry of things,
understanding relations, emotions, actions and intentions.
Real world
scene
Sensing Interpretation
A person
Quoted from Prof. Li Fei-Fei, TED talk
Reference: https://www.ted.com/talks/fei_fei_li_how_we_re_teaching_computers_to_understand_pictures
Photo: https://en.wikipedia.org/wiki/A_picture_is_worth_a_thousand_words
#ISSLearningFest
4. Computer vision in daily life
Photo: https://www.straitstimes.com/singapore/transport/speed-fiends-beware-no-escape-from-new-cameras
A CCTV photo captured on 9 August 2019
Singapore is the 11-th most-surveilled city in the world
86,000 cameras for 5,638,676 people = 15.25 cameras per 1,000 people.
Source: https://www.comparitech.com/vpn-privacy/the-worlds-most-surveilled-cities/
#ISSLearningFest
5. Computer vision in daily life
#ISSLearningFest
1,000 cameras
in Singapore Camera Museum
Photo: https://thesmartlocal.com/read/vintage-
camera-museum/
6. Computer vision in daily life
Reference: https://teachablemachine.withgoogle.com/
#ISSLearningFest
7. Computer vision systems pipeline
Acquisition Processing
Feature
extraction and
learning
Recognition/
Detection
Segmentation/
Action
Decisions
• What objects do
you see?
• Where is this
place?
• Where are cars?
• What is this person
doing?
• What are their
activity?
• How is the crowd
density?
ImageNet; ActivityNet
#ISSLearningFest
8. Key computer vision tasks
What is this image?
Recognition
Is there any human in the image?
Detection
What are their profiles?
Attributes
What are they doing?
Action
#ISSLearningFestPhoto: https://en.wikipedia.org/wiki/You_Are_the_Apple_of_My_Eye
9. Key computer vision tasks
What is this image?
Recognition
Is there any human in the image?
Detection
What are their profiles?
Attributes
What are they doing?
Action
#ISSLearningFestPhoto: https://en.wikipedia.org/wiki/You_Are_the_Apple_of_My_Eye
10. Key computer vision tasks
What is this image?
Recognition
Is there any human in the image?
Detection
What are their profiles?
Attributes
What are they doing?
Action
#ISSLearningFestPhoto: https://en.wikipedia.org/wiki/You_Are_the_Apple_of_My_Eye
11. Key computer vision tasks
What is this image?
Recognition
Is there any human in the image?
Detection
What are their profiles?
Attributes
What are they doing?
Action
#ISSLearningFestPhoto: https://en.wikipedia.org/wiki/You_Are_the_Apple_of_My_Eye
23. Deep learning libraries and platforms
(e.g., TensorFlow/Keras, PyTorch, etc)
Deep learning and convolutional neural network
Intelligent Sensing Systems (ITSS) Graduate Cert
offered by NUS-ISS
Audio and sound processing, analysis, classification
Image processing, analysis, enhancement
Real time machine learning model inference acceleration
3D vision, RGB-D vision, LiDAR, localization
Image classification, detection, segmentation
Video analytics, tracking, action recognition, surveillance
Skillsetsrequiredbyjobscope
ITSS Cert
Vision systems (VSE,
5 days)
Spatial reasoning
from sensor data
(SRSD, 3 days)
Real time audio-
visual sensing and
sense making
(RTAVS, 4 days)
#ISSLearningFest