Visualizing a New Christchurch

900 views

Published on

A talk given by Mark Bilinghurst on January 17th 2012 at the Christchurch Architecture Summer School about how to use Augmented Reality in Architecture and Urban Visualization, especially for the re

Published in: Technology
  • Be the first to comment

Visualizing a New Christchurch

  1. 1. Visualising a New Christchurch Mark Billinghurst HIT Lab NZ University of Canterbury
  2. 2. Christchurch Earthquakes
  3. 3. http://www.rebuildchristchurch.co.nz/content/christchurch-building-demolition-map
  4. 4. Christchurch Before and After
  5. 5.   Professional solutions available   Autodesk REVIST, ESRI ArcGIS, Grass,etc
  6. 6. Emerging Novel User Interfaces  Immersive visualization  Multi-touch screens  Gesture interaction  Etc..
  7. 7. Limitations  Interface   Complex to use   Unintuitive interaction   2D display for 3D content  Context of Use   Remote visualization   Separation from the real world   Unable to show life-sized content
  8. 8. Augmented Reality  Combines Real and Virtual Images -  Both can be seen at the same time  Interactive in real-time -  Content can be interacted with  Registered in 3D -  Virtual objects appear fixed in space
  9. 9. Augmented Reality Examples  Put AR pictures here
  10. 10. AR and Architecture
  11. 11. AR and Archiecture  Enhanced Maps   AR overlay on printed material  Outdoor AR   In place visualization  Mobile AR   Urban Visualization
  12. 12. AR Markerless Tracking  OPIRA Library   Uses natural features for tracking   Fast, robust performance
  13. 13. Interactive AR Maps  Markerless tracking  3D model overlay  Gesture input
  14. 14. Enhanced City Plans  CERA – CCDU Plan   Using tablet to track off printed maps   Overlay 3D city models onto real maps
  15. 15. User Experience  Touch interaction  Pointing selection  Animated objects
  16. 16. Outdoor AR  Highly accurate outdoor AR tracking system   GPS, Inertial, RTK system   HMD  First prototype   Laptop based   2-3 cm accuracy
  17. 17. Image RegistrationAR Surveying Application
  18. 18. Mobile AR - Hardware GPS Example self-built working Antenna solution with PCI-based 3D graphics PCI 3D Graphics Board Tracker Controller PC104 Sound Card DC to DC Wearable Converter CPU Computer PC104 PCMCIA Battery GPS RTK Hard Drive correction Radio Serial PortsColumbia Touring Machine
  19. 19. 2008 - Location Aware PhonesMotorola Droid Nokia Navigator
  20. 20. Real World Information Overlay  Tag real world locations   GPS + Compass input   Overlay graphics on live video  Applications   Travel guide, Advertising, etc  Eg: Layar (www.layar.com)   iPhone, Android based, Public API released  Other companies   Wikitude, Metaio, AcrossAir, Tochnidot, etc
  21. 21. Layar – www.layar.com
  22. 22. 3DOn  Onsite Visualization Single Building   GPS + Compass input   Overlay graphics data on live video/Photos
  23. 23. HIT Lab NZ Outdoor AR Platform  Cross platform   Android, iPhone  3D onsite visualization   Intuitive user interface  Positions content in space   Camera, GPS, compass  Client/Server software architecture  Targeting museum guide/outdoor site applications
  24. 24. CityViewAR  Using AR to visualize Christchurch city buildings   3D models of buildings, 2D images, text, panoramas   AR View, Map view, List view   Available on Android market
  25. 25. User Experience  While walking in the real world people can see text, 2D images and 3D content on their own phones
  26. 26. Interface Design (1/2) Front face Browsing Interface Content AR View Detail View Title Screen Map View Image Gallery Instruction & List View Panorama Information
  27. 27. List ViewList of all assets
  28. 28. Map ViewIcons for buildings, viewpoints, panoramas
  29. 29. Building History Data
  30. 30. Photographic Images
  31. 31. Panorama Images360 degree photo bubbles
  32. 32. Augmented Reality View
  33. 33. Survey Results  Use of AR improved the user experience   But no difference between AR and non-AR usefulness  Favourite features   AR and Panorama views most popular   Users also enjoyed having rich data available  Main Problems (50% reported no problems)   UI design not intuitive (24%)   System not responsive (16%)
  34. 34. Time Usage  Percentage time spent in different views   AR used more then 50% of time when available
  35. 35. Result - Distance Traveled   As a measure of active exploration   M=96.28 meters (SD=83.85, 0~315 meters)Mann-Whitney U-test U = 167.00, p = 0.18 With AR Without AR
  36. 36. Areas for Improvement  Outdoor AR tracking   Reduce tracking errors  User interface design   Make options more obvious  Make system more responsive   Some lag in loading content  Touch input   Responding to unintended touches
  37. 37. AR Urban Design Tool (2012)  CERA CCDU Application   Enhanced CityViewAR application  Add VR view mode   3D model viewing/interaction  Add concept models of buildings   Multiple buildings at single site  Client/Server architecture   Support for user generated feedback
  38. 38. VR View
  39. 39. Differing Views  List View, Content View, Map View
  40. 40. Interaction   Touch interaction   Information filtering   Building information   Model panning, zoom, rotation
  41. 41. iceFest (2012)  Outdoor AR for Antarctic Experience  Visit Antarctica in real world  Using handheld tablet
  42. 42. Map Views
  43. 43. Content Views
  44. 44. AR View  View of ice superimposed over real world
  45. 45. Panorama  Immersive 360 panorama
  46. 46. Feedback  A = Satisfying, B = Ease to use  C = Useful for learning, D = Better learning than internet
  47. 47. Looking to the Future
  48. 48. Next Steps  Subsurface Visualization   See underground infrastructure  User evaluation   Architects, Urban Designers, Public  Develop authoring tool   Web-based content management system  Improve technology   Tracking, 3D rendering
  49. 49. Subsurface Visualization  Using AR to view underground infrastructure
  50. 50. Client/Server Architecture Web Interface Add models Web application java and php server Android application Database server Postgres
  51. 51. Web based Outdoor AR Server  Web interface   Showing POIs as Icons on Google Map  PHP based REST API   XML based scene data retrieval API   Scene creation and modification API   Android client side REST API interface
  52. 52. BASIC VIEW
  53. 53. PERSONAL VIEW
  54. 54. Augmented Reality 2.0 Infrastructure
  55. 55. Leveraging Web 2.0  Content retrieval using HTTP  XML encoded meta information   KML placemarks + extensions  Queries   Based on location (from GPS, image recognition)   Based on situation (barcode markers)  Syndication   Community servers for end-user content   Tagging  AR client subscribes to data feeds
  56. 56. Conclusions•  AR allows for information overlay in place•  CityViewAR provides pre earthquake viewing•  Opportunities for on-going development•  Important research problems need to be solved – Wide area tracking – User experience – Social networking – Etc..
  57. 57. Collaborators  Jason Mills (PVI)   Panoramas, 3D models  Historic Places Trust   Pre-1950 building information  Christchurch City Council   Statements of Significance  CEISMIC   Digital content
  58. 58. More Information•  Mark Billinghurst –  mark.billinghurst@hitlabnz.org •  Website –  www.hitlabnz.org

×