Technologies d’Analyse Vidéo dans le domaine de la sécurité Séminaire MEITO - Analyse vidéo et reconnaissance d'image 01 A...
<ul><ul><ul><li>Jean-Yves Dufour </li></ul></ul></ul><ul><ul><ul><li>Responsable du laboratoire Thales / CEA-LIST « Vision...
Plan de la présentation <ul><ul><li>Video Surveillance :  </li></ul></ul><ul><ul><ul><li>généralités </li></ul></ul></ul><...
What is Video Surveillance ? <ul><ul><li>Surveillance of an infrastructure (store, parking lot, airport, …) through images...
Main application domains <ul><ul><li>Mainly oriented towards security (citizens, assets)  </li></ul></ul><ul><ul><ul><li>T...
Smart Video Surveillance <ul><ul><li>Issues : </li></ul></ul><ul><ul><ul><li>Huge amount of image data (thousands of senso...
Which functionalities ? <ul><ul><li>Detect intrusion </li></ul></ul><ul><ul><ul><li>Presence of somebody in forbidden zone...
Which functionalities ? <ul><ul><li>Loitering : Somebody stays too long time in an “sensible” area </li></ul></ul><ul><ul>...
Which functionalities ? <ul><ul><li>Abandoned / removed object </li></ul></ul><ul><ul><ul><li>   Detection of changes </l...
Which functionalities ? <ul><ul><li>Analyse flow (crowd, vehicles) </li></ul></ul><ul><ul><ul><li>Counting, speed estimati...
Which functionalities ? <ul><ul><li>Recognise : </li></ul></ul><ul><ul><ul><li>Vehicles </li></ul></ul></ul><ul><ul><ul><l...
Which functionalities ? <ul><ul><li>Other (not exhaustive) </li></ul></ul><ul><ul><ul><li>Detect people crossing / jumping...
From research to industry <ul><ul><li>Existing gap between commercial systems and academic research :  </li></ul></ul><ul>...
Thales/CEA Vision Lab <ul><li>Mission : </li></ul><ul><ul><li>Provide Thales “Business lines” with video analysis function...
Thales/CEA Vision Lab <ul><li>Activities (2/2): </li></ul><ul><ul><li>2- Setup an environment and a methodology to develop...
Main actors of the domain <ul><ul><li>Commercial systems and components </li></ul></ul><ul><ul><ul><li>3VR SECURITY, ACIC,...
Upcoming SlideShare
Loading in …5
×

Thales

2,661 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,661
On SlideShare
0
From Embeds
0
Number of Embeds
15
Actions
Shares
0
Downloads
71
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Thales

  1. 1. Technologies d’Analyse Vidéo dans le domaine de la sécurité Séminaire MEITO - Analyse vidéo et reconnaissance d'image 01 Avril 2010
  2. 2. <ul><ul><ul><li>Jean-Yves Dufour </li></ul></ul></ul><ul><ul><ul><li>Responsable du laboratoire Thales / CEA-LIST « Vision Lab » </li></ul></ul></ul><ul><ul><ul><li>Thales Services / ThereSIS </li></ul></ul></ul><ul><ul><ul><li>Campus Polytechnique, </li></ul></ul></ul><ul><ul><ul><li>1, avenue Augustin Fresnel </li></ul></ul></ul><ul><ul><ul><li>91767 Palaiseau Cedex France </li></ul></ul></ul><ul><ul><ul><li>Tél : 01 69 41 59 64 </li></ul></ul></ul><ul><ul><ul><li>Mail : [email_address] </li></ul></ul></ul>
  3. 3. Plan de la présentation <ul><ul><li>Video Surveillance : </li></ul></ul><ul><ul><ul><li>généralités </li></ul></ul></ul><ul><ul><ul><li>Principaux domaines d’application </li></ul></ul></ul><ul><ul><li>Video Surveillance Intelligente </li></ul></ul><ul><ul><li>Quelles fonctionnalités ? </li></ul></ul><ul><ul><li>Transfert recherche / industrie </li></ul></ul><ul><ul><li>Labo Vision de Thales / CEA </li></ul></ul>
  4. 4. What is Video Surveillance ? <ul><ul><li>Surveillance of an infrastructure (store, parking lot, airport, …) through images provided by video cameras observing “strategic” areas. </li></ul></ul><ul><ul><li>two key purposes : </li></ul></ul><ul><ul><ul><li>Recording evidence for investigative purposes </li></ul></ul></ul><ul><ul><ul><li>Providing a human operator with images enabling him to analyse the situation </li></ul></ul></ul><ul><ul><ul><li>generally : to detect and to react </li></ul></ul></ul><ul><ul><li>Huge expansion of Video-Surveillance : </li></ul></ul><ul><ul><ul><li>Due to early 2000 events :governments have made personal and asset security a priority in their policies. </li></ul></ul></ul><ul><ul><ul><li> Deployment of large CCTV systems. </li></ul></ul></ul><ul><ul><ul><ul><li>Example, London Underground and Heathrow Airport have more than 5000 cameras each (2004). </li></ul></ul></ul></ul><ul><ul><ul><li> Major research domain and commercial market or computer vision : </li></ul></ul></ul><ul><ul><ul><ul><li>Many collaborative funded projects, </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Many scientific international workshops / seminars / papers … </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Hundreds of companies created </li></ul></ul></ul></ul>
  5. 5. Main application domains <ul><ul><li>Mainly oriented towards security (citizens, assets) </li></ul></ul><ul><ul><ul><li>Transports </li></ul></ul></ul><ul><ul><ul><ul><li>Railway / underground transportation (stations, tracks , tunnels, wagon) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Airports, </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Urban and motorway road networks, </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Maritime transportation </li></ul></ul></ul></ul><ul><ul><ul><li>Large urban security (roads, streets, public place, …) </li></ul></ul></ul><ul><ul><ul><li>Public events : </li></ul></ul></ul><ul><ul><ul><ul><li>sports, leisure, pilgrimage, … </li></ul></ul></ul></ul><ul><ul><ul><li>Industrial environments </li></ul></ul></ul><ul><ul><ul><ul><li>factories, pipe-line, energy power plants, … </li></ul></ul></ul></ul><ul><ul><ul><li>Border surveillance </li></ul></ul></ul><ul><ul><ul><li>Military applications (remote surveillance, protection of installations) </li></ul></ul></ul>
  6. 6. Smart Video Surveillance <ul><ul><li>Issues : </li></ul></ul><ul><ul><ul><li>Huge amount of image data (thousands of sensors in large systems) </li></ul></ul></ul><ul><ul><ul><li>Human limitations : </li></ul></ul></ul><ul><ul><ul><ul><li>lack of attention span: Human operator cannot maintain an acceptable level of attention for long time </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Sifting through large collections of surveillance videos is tedious and error prone for a human investigator. </li></ul></ul></ul></ul><ul><ul><li> Manual surveillance becomes impractical </li></ul></ul><ul><ul><li> Needs for “situational awareness” </li></ul></ul><ul><ul><li> “ Smart video surveillance” </li></ul></ul>? <ul><ul><ul><li>Assist people in surveillance task: </li></ul></ul></ul><ul><ul><ul><ul><li>the computers watch the video and produces Real-time alerts </li></ul></ul></ul></ul><ul><ul><ul><li>… without fully replacing them : </li></ul></ul></ul><ul><ul><ul><ul><li>People still have to deal with the (false) alarms </li></ul></ul></ul></ul><ul><ul><ul><li>Assist people for post-analysis tasks : </li></ul></ul></ul><ul><ul><ul><ul><li>Indexing video to ease research </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Providing tools to accelerate research </li></ul></ul></ul></ul>
  7. 7. Which functionalities ? <ul><ul><li>Detect intrusion </li></ul></ul><ul><ul><ul><li>Presence of somebody in forbidden zone </li></ul></ul></ul><ul><ul><ul><ul><li>Needs to detect moving object in protected area </li></ul></ul></ul></ul><ul><ul><ul><li>Somebody enters a protected area through forbidden way </li></ul></ul></ul><ul><ul><ul><ul><li>Needs to spatially analyse trajectory of people (tracking) </li></ul></ul></ul></ul>
  8. 8. Which functionalities ? <ul><ul><li>Loitering : Somebody stays too long time in an “sensible” area </li></ul></ul><ul><ul><li>Counting (people, vehicles, lorries, …) : how many objects pass through a given area </li></ul></ul><ul><ul><ul><li> Detection of moving objects </li></ul></ul></ul><ul><ul><ul><li> Classification (people / vehicle or track / lorry, …) </li></ul></ul></ul><ul><ul><ul><li> Tracking to ensure that same person is not counted more than once) </li></ul></ul></ul>Source : Thales Italy and MICC (University of Florence)
  9. 9. Which functionalities ? <ul><ul><li>Abandoned / removed object </li></ul></ul><ul><ul><ul><li> Detection of changes </li></ul></ul></ul>
  10. 10. Which functionalities ? <ul><ul><li>Analyse flow (crowd, vehicles) </li></ul></ul><ul><ul><ul><li>Counting, speed estimation </li></ul></ul></ul><ul><ul><li>Detect abnormal behaviour </li></ul></ul><ul><ul><ul><li>At individual level (eg loitering, jumping over turnstiles, U-turns, …) </li></ul></ul></ul><ul><ul><ul><li>At group level (eg fighting) </li></ul></ul></ul><ul><ul><ul><li>At crowd level (crush) </li></ul></ul></ul>
  11. 11. Which functionalities ? <ul><ul><li>Recognise : </li></ul></ul><ul><ul><ul><li>Vehicles </li></ul></ul></ul><ul><ul><ul><li>Number Plates </li></ul></ul></ul><ul><ul><ul><li>People </li></ul></ul></ul>
  12. 12. Which functionalities ? <ul><ul><li>Other (not exhaustive) </li></ul></ul><ul><ul><ul><li>Detect people crossing / jumping / going / falling on rails </li></ul></ul></ul><ul><ul><ul><li>Surveillance of tube doors closing (in station doors, wagon door) </li></ul></ul></ul><ul><ul><ul><li>General railways protection (cars blocked on a crossing) </li></ul></ul></ul><ul><ul><ul><li>Tunnel entrance or exit surveillance </li></ul></ul></ul><ul><ul><ul><li>Analysis of behavior inside wagon / car (multi-sensor capacities) </li></ul></ul></ul><ul><ul><ul><li>Smoke / Fire detection </li></ul></ul></ul><ul><ul><ul><li>Traffic Management </li></ul></ul></ul><ul><ul><ul><li>Luggage belt surveillance </li></ul></ul></ul>
  13. 13. From research to industry <ul><ul><li>Existing gap between commercial systems and academic research : </li></ul></ul><ul><ul><ul><li>Commercial systems : “simple functions”, dedicated to application and mono-sensor. Main processing tasks : </li></ul></ul></ul><ul><ul><ul><ul><li>intrusion detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>motion detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>detection of packages </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Plate identification </li></ul></ul></ul></ul><ul><ul><ul><li>Academic research : generating more accurate and robust algorithms in : </li></ul></ul></ul><ul><ul><ul><ul><li>object detection, recognition and tracking, </li></ul></ul></ul></ul><ul><ul><ul><ul><li>human activity recognition , </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Scene automatic interpretation from video activity </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Multi-sensor fusion </li></ul></ul></ul></ul><ul><ul><ul><ul><li>database exploration, </li></ul></ul></ul></ul><ul><ul><li>Main issues for technological transfer : </li></ul></ul><ul><ul><ul><ul><li>Difficulty to accurately and exhaustively qualify performance of algorithms </li></ul></ul></ul></ul><ul><ul><ul><ul><li>HW Processing / communication performance </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Signal degradation : </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Frame rate </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Compression </li></ul></ul></ul></ul></ul>
  14. 14. Thales/CEA Vision Lab <ul><li>Mission : </li></ul><ul><ul><li>Provide Thales “Business lines” with video analysis functionalities </li></ul></ul><ul><ul><ul><li>Efficient </li></ul></ul></ul><ul><ul><ul><li>Innovative </li></ul></ul></ul><ul><ul><ul><li>With proved and mastered performances </li></ul></ul></ul><ul><li>Activities (1/2) </li></ul><ul><ul><li>1- Collect / develop a set of building blocks: </li></ul></ul><ul><ul><ul><li>State of the art video analysis algorithms </li></ul></ul></ul><ul><ul><ul><li>Developed by CEA/LIST </li></ul></ul></ul><ul><ul><ul><li>Completed with technologies provided by : </li></ul></ul></ul><ul><ul><ul><ul><li>Thales technical teams (“Vision cluster”) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Selected Partners (academic labs / SMEs) </li></ul></ul></ul></ul>
  15. 15. Thales/CEA Vision Lab <ul><li>Activities (2/2): </li></ul><ul><ul><li>2- Setup an environment and a methodology to develop and test processing chains </li></ul></ul><ul><ul><ul><li>Heterogeneous network of sensors </li></ul></ul></ul><ul><ul><ul><ul><li>> 30 cameras, indoor and outdoor, still or PTZ. </li></ul></ul></ul></ul><ul><ul><ul><li>SW platform </li></ul></ul></ul><ul><ul><ul><ul><li>Plug-in architecture </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Complete processing chain from sensors to HMI </li></ul></ul></ul></ul><ul><ul><ul><li>HW platform </li></ul></ul></ul><ul><ul><ul><ul><li>High Computing power: 150 physical bi-proc servers, 4-core Xeon 2,5 GHz, 32 GB Ram for each server </li></ul></ul></ul></ul><ul><ul><ul><ul><li>High Storage capacity ( 10 TB) </li></ul></ul></ul></ul><ul><ul><ul><li>Wide image database (Standard Corpus , Video provided by customers) </li></ul></ul></ul><ul><ul><ul><li>Testing and evaluation tools and procedures </li></ul></ul></ul><ul><ul><ul><li>Use of image simulation technologies to : </li></ul></ul></ul><ul><ul><ul><ul><li>create scenarios difficult to encounter in real world (but which define the alarms) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Fully controlled scene and image characteristics </li></ul></ul></ul></ul>
  16. 16. Main actors of the domain <ul><ul><li>Commercial systems and components </li></ul></ul><ul><ul><ul><li>3VR SECURITY, ACIC, AEXEON ANALYTIX, AGENT VI, AIMETIS, ARALIA, AXIS, BLUE EYE VIDEO, BOSCH, CERNIUM, CISCO, CITILOG, DYNAPEL, DVTEL, EADS, EMITALL, EVITECH, FOXSTREAM, GE SECURITY, GENETEC, GEUTEBRUCK, GEOVISION, HONEYWELL, IBM-ISS, INDIGOVISION, INTELLIO, INTELLIVIEW, INTELLIVISION, IOIMAGE, IOMNISCIENT, IPSOTEK, IVISIOTECH, KAOLAB, KEENEO, LENEL, MAGAL, MANGO DSP, MARCH, MATE, MILESTONE SYSTEMS, MIOVISION, MOSAIC TECHNOLOGY, TRAFFICON, NEXVISION, NICE VISION, OBJECTVIDEO, OPAX, ONSSI, PIVOTAL VISION, PRAETORIAN, PYRAMID VISION – SARNOFF, SAGEM, SECUSCAN, SIEMENS, SONY, SPIKENET, THALES, VERINT, VIDEALERT, VIDEOMINING, VIDIENT, VIGILANT TECHNOLOGY, VISIOWAVE, VIVOTEK ….. </li></ul></ul></ul><ul><ul><li>This list is not exhaustive !!! </li></ul></ul><ul><ul><li>Collaborative programs (EU) </li></ul></ul><ul><ul><ul><li>CROMATICA, PRISMATICA, ADVISOR, CARETAKER, VIEWS, … </li></ul></ul></ul><ul><ul><li>Main research teams </li></ul></ul><ul><ul><ul><li>Partners of previous programs </li></ul></ul></ul>

×