Video analytics for public safety solutions Senior Researcher Media Systems Research Department, Center for Technology Innovation - Systems Eng. Hitachi, Ltd., Research & Development Group

1. © Hitachi, Ltd. 2015. All rights reserved.
Video analytics for
public safety solutions
Senior Researcher
Media Systems Research Department,
Center for Technology Innovation - Systems Eng.
Hitachi, Ltd., Research & Development Group
Oct. 5th, 2015
Tomokazu Murakami Ph.D.

2. © Hitachi, Ltd. 2015. All rights reserved. 1
Contents
1. Our vision
2. Video analytics for public safety
2-1. Human tracking & classification
2-2. Multi-perspective search
2-3. Finger-vein authentication system
3. Conclusion

3. © Hitachi, Ltd. 2015. All rights reserved.
1. Our vision
2

4. © Hitachi, Ltd. 2015. All rights reserved. 3
1-1. Our vision: overview
IT Platform
Railway and Infrastructure
Analytics and Media
technologies
Cloud computing
Data center
Stroage
Trains Construction machinery
ITS
Smart grid
Healthcare
Video surveillance
Cyber security
Railway systems
Hitachi has a wide variety of technologies ranging from
hardware and systems to software and analytics.
Big data analytics
Media processing
Providing cutting edge solutions combining with
analytics and platform technologies

5. © Hitachi, Ltd. 2015. All rights reserved. 4
Providing safety and comfort with analytics technologies
1-2. Our vision for public safety solution
Guard
robot
Walk-through
finger-vein
authentication
Explosive
detector
Traffic simulation
Video analytics
Surveillance camera

6. © Hitachi, Ltd. 2015. All rights reserved.
2. Video analytics for public safety
5

7. © Hitachi, Ltd. 2015. All rights reserved.
2-1. Human tracking
6
Calculate and integrate
the optical flows of
pedestrians
6 persons
Real-time and robust in crowded situations human tracking
•Counting people for congestion estimation
•Preventing from accidents by overcrowding
•Detecting and locating the position of
pedestrians by integrating optical flows
captured by surveillance video.
•Real-time calculation
•Robust even in crowded situations
Estimate the trajectories
and congestion degree
Purpose Technology

8. © Hitachi, Ltd. 2015. All rights reserved. 7
2-1. Human tracking (demo video)
Optical flow
Estimated
position
Congestion
degree
Human detecting and locating
Smart human counting in
crowded situation

9. © Hitachi, Ltd. 2015. All rights reserved. 8
Demo video
Examples of
detection targets
• Real-time classification of human behavior and belongings
• Helping clerks for supporting passengers, customers
Video
analysis
Remote
monitoring
Trouble
prevention
Support for
handicapped
person
System overview
Category Targets Category Targets
Human behavior
Windingly walking
Objects,
belongings
Passenger with
white cane
Loitering Passenger with
long pole
Wheeler
Stroller
Wheelchair Objects left behind
2-1. Human classification

10. © Hitachi, Ltd. 2015. All rights reserved.
2-2. Multi-perspective search (overview)Accident
Huge volume video data
Surveillance
camera Video recorder
Video
content
analysis
Clues from witnesses
He was bringing
a green backpack.
I saw a suspicious guy
wearing blue parka.
Finding
suspicious
person
High-speed
Image search
Search the person having
"a green backpack" and
wearing "blue parka."
 Even unregistered persons can be searched by appearance from recorded video
 Color of items, face, trail of movement, etc.
9
Suspect-tracking technology based on clothing, hand luggage and route taken

11. © Hitachi, Ltd. 2015. All rights reserved.
 Detection of faces, clothes, hand luggage and route from video data
 Registration of image features extracted from above objects
 High-speed search of specific person （36M images/seconds）
Surveillance camera
Smartphone video
Video recorder
Video analytics Multi-perspective search GUI
Face
detection
Head
detection
Object
detection
Analytics
modules
Tracking
Face DB
Head DB
Clothes DB
Object DB
Track DB
Input human
feature
Search results
Input route taken
2-2. Multi-perspective search (demo)
10

12. © Hitachi, Ltd. 2015. All rights reserved. 11
2-3. Finger-vein authentication (overview)
 Emerging threats of terrorism to large events
 Trade-off between certainty of inspection of attendees and throughput of
gate entrance.
Stadiums
・ ID inspection
・ Checking tickets etc.
Rigorous inspection leads to severe congestion
Stations
Entrance
Providing innovative authentication system – high speed with high accuracy

13. © Hitachi, Ltd. 2015. All rights reserved. 12
2-3. Finger vein authentication (technology)
Walk-through
Pattern
• Stop and put a finger
into the equipment
Problems Technology
Congestion
• Walk-through finger vein authentication
Movement
3D image
IR image
LED
projection
Finger
detection
Estimating posture
from 3D image
Capturing images of
moving fingers
Touch &
Go
Realizing walk-through authentication, same rate as automatic ticket gate

14. © Hitachi, Ltd. 2015. All rights reserved.
2-3. Finger vein authentication (demo video)
 Greater security and reduced congestion at admission gates where crowds form
 Authenticated by passing fingers over the reader (70 person/min)
Finger vein authentication technology
for smooth and accurate walkthrough-style personal verification

15. © Hitachi, Ltd. 2015. All rights reserved.
3. Conclusion
14

16. © Hitachi, Ltd. 2015. All rights reserved. 15
3. Conclusion
 Our vision for public safety solution was explained.
 Video analytics technologies developed by Hitachi are
introduced.
 In order to expand our activity globally, we would like to
accelerate communication with customers and partner
companies.
Thank you.