The Australian Centre for Visual Technologies Professor Anton van den Hengel,  Director ACVT The University of Adelaide ww...
Visual Technologies <ul><li>The production and analysis of visual digital media </li></ul><ul><li>Primary research areas: ...
Staff <ul><li>5 Academics </li></ul><ul><li>14 Research staff </li></ul><ul><ul><li>2 more on the way </li></ul></ul><ul><...
Interactive 3D modelling <ul><li>3D modelling is critical to all sorts of application </li></ul><ul><ul><li>Special effect...
Input
Modelling
Results
Low polygon-count modeling <ul><li>Insert your own objects into a game </li></ul><ul><li>Put your couch into second life <...
Put your truck into a game
Put your truck into a game
Modelling for animation
Video editing requires models
Video editing requires models
Modelling architecture
Modeling for virtual environments
Modeling for virtual environments
Modeling for virtual environments
Intelligent Video Surveillance <ul><li>Enabling wide area video surveillance </li></ul><ul><ul><li>Protection of people an...
<ul><li>Camera surveillance is ubiquitous </li></ul><ul><ul><li>London citizens viewed  >300 times per day </li></ul></ul>...
<ul><li>Live human monitoring needs to focus on key events </li></ul><ul><ul><li>Need systems need to detect such events <...
Intelligent Video Surveillance <ul><li>Camera topology </li></ul><ul><ul><li>Geometric relationship </li></ul></ul><ul><li...
 
<ul><li>O utputs from activity topology  analysis : </li></ul><ul><ul><li>Knowledge of which  regions  are linked </li></u...
Intelligent Video Surveillance <ul><li>Abstract over individual cameras </li></ul><ul><li>Present only the most important ...
Natural Augmented Reality <ul><li>Augmenting reality requires accessible models of real objects </li></ul><ul><ul><li>Cann...
Natural Augmented Reality
In-situ modelling
Live effects <ul><li>Using AR to put special effects into video, as it’s captured </li></ul><ul><ul><li>Copy and paste obj...
Minimal interaction AR modelling
Augmented Reality <ul><li>The interaction between real and virtual objects is a key problem in AR </li></ul><ul><li>Modell...
Augmented Reality
Modelling plants <ul><li>W orking with The Australian Centre for Plant Functional Genomics, and the Plant Accelerator </li...
Modelling plants <ul><li>Developing methods for consistently labelling parts of plants </li></ul><ul><ul><li>Over time </l...
Modelling plants <ul><li>Plants  </li></ul><ul><ul><li>Have complicated shapes </li></ul></ul><ul><ul><li>Overlap </li></u...
Modelling plants <ul><li>Approach </li></ul><ul><ul><li>3D volumetric models </li></ul></ul><ul><ul><li>Multiple hypothesi...
Simulation <ul><li>Serious Games </li></ul><ul><li>Working with </li></ul><ul><ul><li>BHP Billiton </li></ul></ul><ul><ul>...
Search in large image sets <ul><li>Developing methods capable of extracting information from large image databases </li></...
Search in large image sets
 
Search in large image sets <ul><li>Databases of > 10 6  images or video </li></ul><ul><li>Image or text queries </li></ul>...
Unmanned Aerial Video <ul><li>Aerial surveillance </li></ul>
3D modelling from video <ul><li>Unmanned Aerial Video </li></ul><ul><ul><li>Generate a topographic map based on video take...
Terrain reconstruction from UAVideo
ACVT Experience <ul><li>Development of iOmniscient IP </li></ul><ul><ul><li>Now the highest selling intelligent video surv...
<ul><li>The Background Change Detection System  </li></ul><ul><ul><li>2003 Business and Industrial Solutions Award </li></...
ACVT Experience <ul><li>Background Change sales made around the world </li></ul><ul><ul><li>First sale to    Royal Ontario...
Upcoming SlideShare
Loading in …5
×

ACVT Capabilities Show

512 views

Published on

Shows some of the capabilities and research results of The Australian Centre for Visual Technologies

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
512
On SlideShare
0
From Embeds
0
Number of Embeds
57
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

ACVT Capabilities Show

  1. 1. The Australian Centre for Visual Technologies Professor Anton van den Hengel, Director ACVT The University of Adelaide www.acvt.com.au
  2. 2. Visual Technologies <ul><li>The production and analysis of visual digital media </li></ul><ul><li>Primary research areas: </li></ul><ul><ul><li>Intelligent video surveillance </li></ul></ul><ul><ul><ul><li>Enabling thousand-camera surveillance networks </li></ul></ul></ul><ul><ul><li>3D modelling from image sets </li></ul></ul><ul><ul><ul><li>Interactive scene modelling from image sets </li></ul></ul></ul><ul><ul><li>Learning from large image sets </li></ul></ul>
  3. 3. Staff <ul><li>5 Academics </li></ul><ul><li>14 Research staff </li></ul><ul><ul><li>2 more on the way </li></ul></ul><ul><li>10 PhD students </li></ul><ul><li>2 Coders </li></ul><ul><li>1 Business Manager </li></ul>
  4. 4. Interactive 3D modelling <ul><li>3D modelling is critical to all sorts of application </li></ul><ul><ul><li>Special effects, but also mining, architecture, defence, urban planning, … </li></ul></ul><ul><li>People are getting more visually sophisticated </li></ul><ul><li>More 3D data is being generated </li></ul><ul><ul><li>More cameras, but also scanners etc </li></ul></ul><ul><li>The interfaces of modelling programs are usually very hard to fathom </li></ul>
  5. 5. Input
  6. 6. Modelling
  7. 7. Results
  8. 8. Low polygon-count modeling <ul><li>Insert your own objects into a game </li></ul><ul><li>Put your couch into second life </li></ul><ul><li>Model your house for Google Earth </li></ul><ul><li>Video editing </li></ul><ul><ul><li>Cut and paste between sequences </li></ul></ul><ul><ul><li>Remove someone from your home videos </li></ul></ul>
  9. 9. Put your truck into a game
  10. 10. Put your truck into a game
  11. 11. Modelling for animation
  12. 12. Video editing requires models
  13. 13. Video editing requires models
  14. 14. Modelling architecture
  15. 15. Modeling for virtual environments
  16. 16. Modeling for virtual environments
  17. 17. Modeling for virtual environments
  18. 18. Intelligent Video Surveillance <ul><li>Enabling wide area video surveillance </li></ul><ul><ul><li>Protection of people and property </li></ul></ul><ul><ul><ul><li>Various scales of threat, eg assault to catastrophe </li></ul></ul></ul><ul><ul><li>Perimeter defence/monitoring </li></ul></ul><ul><ul><li>Increased detection of theft, reduced false alarms </li></ul></ul><ul><ul><ul><li>More effective use of police and other security resources </li></ul></ul></ul><ul><ul><li>Road traffic analysis </li></ul></ul><ul><ul><li>Public liability </li></ul></ul><ul><ul><ul><li>Archived footage provides defence against spurious claims </li></ul></ul></ul>
  19. 19. <ul><li>Camera surveillance is ubiquitous </li></ul><ul><ul><li>London citizens viewed >300 times per day </li></ul></ul><ul><ul><li>>1M cameras in London </li></ul></ul><ul><li>Cameras monitor streets, shops, airports, etc </li></ul><ul><li>What happens to the video? </li></ul><ul><ul><li>Most video is never seen </li></ul></ul><ul><ul><li>Little observed in real time </li></ul></ul><ul><ul><li>Forensic value only </li></ul></ul><ul><li>Understanding the relationships between cameras fundamentally changes what you can do with video </li></ul><ul><ul><li>Live analysis </li></ul></ul><ul><ul><li>Forensically </li></ul></ul>Intelligent Video Surveillance
  20. 20. <ul><li>Live human monitoring needs to focus on key events </li></ul><ul><ul><li>Need systems need to detect such events </li></ul></ul><ul><ul><li>Scalable solutions </li></ul></ul><ul><ul><li>Allows more effective responses </li></ul></ul><ul><li>Forensic analysis needs to be faster and smarter </li></ul><ul><ul><li>Need semi-automated data mining </li></ul></ul><ul><li>What we are creating is a virtual director, who gives the operator the most important information available at any moment </li></ul>Intelligent Video Surveillance
  21. 21. Intelligent Video Surveillance <ul><li>Camera topology </li></ul><ul><ul><li>Geometric relationship </li></ul></ul><ul><li>Activity topology </li></ul><ul><ul><li>Characterise movement of targets between video fields of view </li></ul></ul><ul><ul><li>Tells you where to look when a target leaves the field of view of the camera you are currently watching </li></ul></ul>
  22. 23. <ul><li>O utputs from activity topology analysis : </li></ul><ul><ul><li>Knowledge of which regions are linked </li></ul></ul><ul><ul><li>Given an object’s arrival in a region , the relative likelihood that it came from any of the connected regions </li></ul></ul><ul><ul><li>Statistics re time taken to transit between regions </li></ul></ul><ul><ul><li>Information re typical appearance changes between regions (scale, brightness, etc) </li></ul></ul>Intelligent Video Surveillance
  23. 24. Intelligent Video Surveillance <ul><li>Abstract over individual cameras </li></ul><ul><li>Present only the most important information at any time </li></ul><ul><li>Effective exploitation of automatic and human analysis </li></ul>
  24. 25. Natural Augmented Reality <ul><li>Augmenting reality requires accessible models of real objects </li></ul><ul><ul><li>Canned models are not practical </li></ul></ul><ul><ul><li>Need to create them in-situ </li></ul></ul>
  25. 26. Natural Augmented Reality
  26. 27. In-situ modelling
  27. 28. Live effects <ul><li>Using AR to put special effects into video, as it’s captured </li></ul><ul><ul><li>Copy and paste objects </li></ul></ul><ul><ul><li>Delete objects </li></ul></ul><ul><ul><li>Add synthetic geometry </li></ul></ul>
  28. 29. Minimal interaction AR modelling
  29. 30. Augmented Reality <ul><li>The interaction between real and virtual objects is a key problem in AR </li></ul><ul><li>Modelling can solve this problem </li></ul>
  30. 31. Augmented Reality
  31. 32. Modelling plants <ul><li>W orking with The Australian Centre for Plant Functional Genomics, and the Plant Accelerator </li></ul><ul><ul><li>Hundreds of plants with differing genes grown on a conveyor belt </li></ul></ul><ul><ul><li>Interested in how environment affects yield </li></ul></ul>
  32. 33. Modelling plants <ul><li>Developing methods for consistently labelling parts of plants </li></ul><ul><ul><li>Over time </li></ul></ul><ul><ul><li>Over different plants </li></ul></ul><ul><li>3D models are a by-product </li></ul>
  33. 34. Modelling plants <ul><li>Plants </li></ul><ul><ul><li>Have complicated shapes </li></ul></ul><ul><ul><li>Overlap </li></ul></ul><ul><ul><li>Move </li></ul></ul><ul><ul><li>Grow </li></ul></ul><ul><ul><li>Die </li></ul></ul><ul><ul><li>Have a grammar </li></ul></ul>
  34. 35. Modelling plants <ul><li>Approach </li></ul><ul><ul><li>3D volumetric models </li></ul></ul><ul><ul><li>Multiple hypothesis labelling </li></ul></ul><ul><ul><li>Reconcile models over image pairs </li></ul></ul>
  35. 36. Simulation <ul><li>Serious Games </li></ul><ul><li>Working with </li></ul><ul><ul><li>BHP Billiton </li></ul></ul><ul><ul><li>UNSW </li></ul></ul><ul><ul><li>TAFE </li></ul></ul><ul><ul><li>… </li></ul></ul>
  36. 37. Search in large image sets <ul><li>Developing methods capable of extracting information from large image databases </li></ul><ul><ul><li>Google earth </li></ul></ul><ul><ul><li>Streetview </li></ul></ul><ul><ul><li>Surveillance video </li></ul></ul>
  37. 38. Search in large image sets
  38. 40. Search in large image sets <ul><li>Databases of > 10 6 images or video </li></ul><ul><li>Image or text queries </li></ul><ul><li>Results in seconds </li></ul>
  39. 41. Unmanned Aerial Video <ul><li>Aerial surveillance </li></ul>
  40. 42. 3D modelling from video <ul><li>Unmanned Aerial Video </li></ul><ul><ul><li>Generate a topographic map based on video taken from an unmanned aerial vehicle </li></ul></ul><ul><ul><li>Relies on video only </li></ul></ul><ul><ul><ul><li>No GPS, lidar, inertial … </li></ul></ul></ul>
  41. 43. Terrain reconstruction from UAVideo
  42. 44. ACVT Experience <ul><li>Development of iOmniscient IP </li></ul><ul><ul><li>Now the highest selling intelligent video surveillance product world-wide </li></ul></ul><ul><li>Research contracts with DSTO, Canon (CiSRA) </li></ul><ul><li>Collaborations with Tenix, Coastwatch … </li></ul><ul><li>Development of networked camera surveillance platform </li></ul><ul><ul><li>Patent pending </li></ul></ul>
  43. 45. <ul><li>The Background Change Detection System </li></ul><ul><ul><li>2003 Business and Industrial Solutions Award </li></ul></ul><ul><ul><ul><li>Secrets of Australian IT Innovation </li></ul></ul></ul><ul><ul><li>British Security Industry Association </li></ul></ul><ul><ul><ul><li>“ Best Intelligent Surveillance Product” winner at IFSEC 2004 </li></ul></ul></ul><ul><ul><ul><li>Judges: Security Mgrs for Lloyds and Tesco, Head of Security Group of Ministry of Defence, Director of Police Scientific Development Board, eds of several key European Security Magazines. </li></ul></ul></ul><ul><ul><ul><li>&quot;...what iOmniscient has to offer is years ahead of anything else we have seen to date.&quot; BSIA President. </li></ul></ul></ul>ACVT Experience
  44. 46. ACVT Experience <ul><li>Background Change sales made around the world </li></ul><ul><ul><li>First sale to Royal Ontario Art Gallery </li></ul></ul><ul><ul><li>Recent sale - Sydney Harbour Bridge monitoring </li></ul></ul><ul><ul><li>On-licensed to 2020 Vision Systems in UK </li></ul></ul><ul><ul><li>Adelaide airport </li></ul></ul><ul><ul><li>Many other confidential sales </li></ul></ul>

×