IBM iForum - Augmented Reality Vtt by Charles Woodward


Published on

Deck from the IBM iForum 2007 event in Zurich talking about Augmented Reality. Courtesy from Charles Woodward

Published in: Business, Technology
  • Thanks for dropping by and for the feedback comments! I have just gone through your blog post and that's a wonderful write-up! I surely agree with you that both of them can, and should!, walk hand in hand and the way you have described it just fits in perfect! Glad to know you have included this resource as well as part of the article. Greatly appreciated! Will share it across with a few folks I know who are interested in the topic as well. Thanks!!
    Are you sure you want to  Yes  No
    Your message goes here
  • Great slideshow, I referenced it in a post I just completed here: One of the most interesting things is the relationship between the Internet of Things and Augmented Reality, they seem to be bound by the same fundamental requirements in both technology and adoption. Thanks for the post.
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • IBM iForum - Augmented Reality Vtt by Charles Woodward

    1. 1. Augmented Reality Prof. Charles Woodward VTT Technical Research Centre of Finland
    2. 2. Outline <ul><li>Introduction </li></ul><ul><ul><li>VTT </li></ul></ul><ul><ul><li>Virtual and Augmented Reality </li></ul></ul><ul><li>Applications at VTT </li></ul><ul><ul><li>Entertainment, marketing </li></ul></ul><ul><ul><li>Interior design, architecture </li></ul></ul><ul><ul><li>Mobile Augmented Reality </li></ul></ul><ul><ul><li>Production applications </li></ul></ul><ul><li>Augmented Reality Future </li></ul><ul><ul><li>Some new ideas </li></ul></ul><ul><ul><li>Enabling technologies </li></ul></ul><ul><ul><li>Trends and Drivers </li></ul></ul>
    4. 4. VTT Profile <ul><li>7 Knowledge Clusters </li></ul><ul><ul><li>Digital Information Systems </li></ul></ul><ul><ul><li>Telecommunications </li></ul></ul><ul><ul><li>Microtechnologies and Sensors </li></ul></ul><ul><ul><li>Materials and Building </li></ul></ul><ul><ul><li>Industrial Systems </li></ul></ul><ul><ul><li>Biotechnology </li></ul></ul><ul><ul><li>Energy and Pulp&Paper </li></ul></ul><ul><li>Figures </li></ul><ul><ul><li>2 700 employees </li></ul></ul><ul><ul><li>233 M€ research budget </li></ul></ul><ul><ul><li>45 Knowledge Centres </li></ul></ul>Basic research Applied research Development work VTT INDUSTRY UNIVERSITIES
    5. 5. Virtual and Augmented Reality at VTT <ul><li>VR/AR Roadmap report 2005 </li></ul><ul><ul><li>Fourteen VTT research teams contributing </li></ul></ul><ul><ul><li>Applications from entertainment to digital media, construction to production, ships, military, etc. </li></ul></ul><ul><li>Technology, incl. </li></ul><ul><ul><li>Core VR/AR solutions </li></ul></ul><ul><ul><li>Machine vision, feature tracking </li></ul></ul><ul><ul><li>Multimodality, 3D audio etc. </li></ul></ul><ul><ul><li>Motion tracking, avatars, sensors </li></ul></ul><ul><ul><li>GSM/GPS positioning, GIS systems </li></ul></ul><ul><ul><li>Ambient intelligence, context sensitivity, … </li></ul></ul><ul><li>Special strenghts </li></ul><ul><ul><li>Multi-disciplinary research </li></ul></ul><ul><ul><li>Strong industry relations and experience </li></ul></ul>
    6. 6. Virtual Reality (Introduction) <ul><li>Devices, incl. </li></ul><ul><ul><li>Head Mounted Displays (HMD), data gloves, motion trackers, ... </li></ul></ul><ul><li>CAVE systems </li></ul><ul><ul><li>“ Lumeportti” - VTT’s proprietary CAVE for 3D data visualisation </li></ul></ul><ul><ul><li>Utilises video projectors, networked PCs and low-cost VR technology </li></ul></ul><ul><ul><li>Provides steroscopic walk-through functionality with gesture-based interaction </li></ul></ul><ul><ul><li>Applications e.g. space ship simulation for Alenia Spazio </li></ul></ul>
    7. 7. Augmented Reality <ul><li>Augmented Reality (AR) </li></ul><ul><ul><li>Mixes virtual objects with user’s view of real world </li></ul></ul><ul><ul><li>Properties: real-time, interactive, 3D </li></ul></ul><ul><li>Related technologies </li></ul><ul><ul><li>Augmented Virtuality </li></ul></ul><ul><ul><li>Mediated Reality </li></ul></ul><ul><ul><li>Diminished Reality </li></ul></ul><ul><ul><li>Mixed Reality </li></ul></ul><ul><li>Display devices </li></ul><ul><ul><li>PC screen + web camera (”Magic mirror”) </li></ul></ul><ul><ul><li>Data glasses (video or optical see through HMD) </li></ul></ul><ul><ul><li>Hand held devices, camera phones (”Magic lense”) </li></ul></ul>Reality Augmented Reality Augmented Virtuality Virtual Reality Mixed Reality
    9. 9. <ul><li>ARCatalogue </li></ul><ul><ul><li>Enhanced ”Magic Book” application </li></ul></ul><ul><ul><li>In real marketing use by e.g. Lappset Group </li></ul></ul><ul><li>ARCipher </li></ul><ul><ul><li>Implementation on camera phones </li></ul></ul><ul><ul><li>Augmenting on matrix codes </li></ul></ul>AR in Marketing / Media
    10. 10. <ul><li>CamBall </li></ul><ul><ul><li>Augmented networked table tennis </li></ul></ul><ul><li>SymBall </li></ul><ul><ul><li>Virtual table tennis for camera phones </li></ul></ul><ul><li>StereoGames </li></ul><ul><ul><li>3D Stereo display enhancement </li></ul></ul>AR in Games / Entertainment
    11. 11. AR at Homes / Interiors <ul><li>Basic solution </li></ul><ul><ul><li>Virtual furniture object tied to each marker </li></ul></ul><ul><li>ARInteriors </li></ul><ul><ul><li>Augmented digital images </li></ul></ul><ul><li>ARPhone </li></ul><ul><ul><li>Virtual furniture on phone’s camera image </li></ul></ul><ul><ul><li>Downloading models by matrix codes </li></ul></ul>
    12. 12. <ul><li>ARScaleModel </li></ul><ul><ul><li>Virtual scale model augmented on table </li></ul></ul><ul><ul><li>Stereo viewing using data glasses </li></ul></ul><ul><ul><li>Virtual cursor for user interaction </li></ul></ul><ul><li>Including </li></ul><ul><ul><li>ARCatalogue for selecting components </li></ul></ul><ul><ul><li>Virtual reality walk-through inside the model </li></ul></ul>AR on the Table / Collaboration
    13. 13. <ul><li>Outdoors visualisation of Digitalo </li></ul><ul><ul><li>Commission by Senate Properties, spring 2003 </li></ul></ul><ul><ul><li>Client/server implementation with PDA & WLAN </li></ul></ul><ul><ul><li>Using large 80 x 80 cm markers, Speed 2 frames / sec </li></ul></ul><ul><li>Markerless implementation “AROnSite” </li></ul><ul><ul><li>Feature based tracking </li></ul></ul><ul><ul><li>Interactive positioning of building to real scene </li></ul></ul><ul><ul><li>E.g. Helsinki Music Hall visualisation 2006 </li></ul></ul>Mobile Augmented Reality
    14. 14. <ul><li>Google Earth + AROnSite </li></ul><ul><ul><li>Building placed in Google Earth </li></ul></ul><ul><ul><li>Semi-automatic positioning using GPS </li></ul></ul><ul><li>Applications, e.g. </li></ul><ul><ul><li>Paper mill visualisations by Pöyry Plc 2007 </li></ul></ul><ul><ul><li>Excavator visualisations for Metso Minerals 2007 </li></ul></ul><ul><li>Future work </li></ul><ul><ul><li>Automatic positioning, e.g. matching map and cam view </li></ul></ul><ul><ul><li>Implementation on camera phones </li></ul></ul>“ Google Earth on Earth”
    15. 15. <ul><li>ARWebCam </li></ul><ul><ul><li>Augmented reality webcamera </li></ul></ul><ul><ul><li>Application during Digitalo construction 2003 – 2005 </li></ul></ul><ul><ul><li>VTT being the first in the world to implement </li></ul></ul><ul><li>3D Terrain </li></ul><ul><ul><li>Semiautomatic creation of 3D environment </li></ul></ul><ul><ul><li>Based on aerial photos and geographic information </li></ul></ul><ul><ul><li>Incl. trees, surrounding buildings, terrain shapes </li></ul></ul>AR in the Web
    17. 17. Industry Partners, e.g.
    18. 18. <ul><li>Further applications by Pöyry Plc </li></ul><ul><li>ARCatalogue for technical machinery documents </li></ul><ul><li>Helmet with integrated camera & data glasses </li></ul><ul><ul><li>Emagin video glasses / Micro-optical PC viewer </li></ul></ul><ul><ul><li>Lightweight, battery mounted inside helmet </li></ul></ul>Project SPECIAL
    19. 19. <ul><li>Objective </li></ul><ul><ul><li>To provide ubiquitous access to plant information using intuitive mobile user interfaces / Augmented Reality </li></ul></ul><ul><li>Results </li></ul><ul><ul><li>Core-task analyses for operational and maintenance work to consider and define interfaces between actions and actors including outsourcing of services </li></ul></ul><ul><ul><li>An ontology based modeling environment for linking plant model information from several sources e.g. for augmented visualisation of 3D constructions </li></ul></ul><ul><ul><li>AR demonstrations on gasification simulation process; the u ser can e.g. change controls and study changes in process values, and retrienve service instructions of the identified equipment </li></ul></ul><ul><ul><li>Employing AR in the design phase to support information transfer between design, installation, implementation and maintenance </li></ul></ul>Project PLAMOS
    20. 20. <ul><li>Objective: to study studies methods and tools for ubiquitous plant model usage </li></ul><ul><ul><li>Continuation to PLAMOS, but stronger emphasis on locationing techniques & pilot applications </li></ul></ul><ul><li>Location aware services and augmented reality techniques studied in process industry surroundings in order to provide plant model services to a mobile device </li></ul><ul><ul><li>Technologies: model based tracking, pseudosatellites </li></ul></ul><ul><li>Participating companies </li></ul><ul><ul><li>Fortum Nuclear Services, Pöyry Forest Industry, Metso Paper, Wärtsilä, Nokia Research Center, Cadmatic, Space Systems Finland, R.A. TR-Consulting </li></ul></ul><ul><li>Timetable </li></ul><ul><ul><li>26.9.2007-31.7.2009, funding from Tekes and companies </li></ul></ul>Project NOSE
    21. 21. <ul><li>Augmented Assembly </li></ul><ul><ul><li>Timetable: 1.8.2006-31.7.2008 </li></ul></ul><ul><ul><li>Funding from Tekes and companies </li></ul></ul><ul><li>Objective: Increasing efficiency in assembly work with Augmented Reality </li></ul><ul><ul><li>Development of the manufacturing process using AR </li></ul></ul><ul><ul><li>Integration of AR to CAD/PLM/ERP systems </li></ul></ul><ul><ul><li>Content creation (authoring) for Augmented Assembly </li></ul></ul><ul><ul><li>Exploring AR display devices in assembly factory </li></ul></ul><ul><ul><li>Work tool sensor feedback into AR systems </li></ul></ul><ul><ul><li>Development of a AugAsse demonstration system </li></ul></ul><ul><ul><li>Development of pilot applications at customer companies </li></ul></ul><ul><li>Advantages </li></ul><ul><ul><li>Visual and smart information for manual working phases </li></ul></ul><ul><ul><li>Faster work and less faults </li></ul></ul><ul><ul><li>Uniform quality </li></ul></ul><ul><ul><li>Steep learning curve </li></ul></ul><ul><ul><li>Customer-driven design change management </li></ul></ul>Project AugAsse
    23. 23. Project Proposal ”TelePet” Internet <ul><li>Augmented Networked Games for Dogs </li></ul><ul><ul><li>To entertain dogs over Internet during master’s absence </li></ul></ul><ul><ul><li>Game control based on gesture detection </li></ul></ul><ul><li>Example game </li></ul><ul><ul><li>Master throws virtual ball, dog has to “catch” </li></ul></ul><ul><ul><li>Dog sees silhouette on the screen, ball bounces back if “caught” </li></ul></ul><ul><ul><li>Further rewards, e.g. biscuit box operated over internet </li></ul></ul>
    24. 24. Project Proposal ”AR4BC” <ul><li>“ Augmented Reality for Building and Construction” </li></ul><ul><ul><li>To provide mobile AR (MR) tools linking real situation at construction site to Building Information Models (BIM) information, planning and follow-up </li></ul></ul><ul><li>Augmented on-site visualisation </li></ul><ul><ul><li>linking project plans with actual situation on site </li></ul></ul><ul><li>Augmented site journaling </li></ul><ul><ul><li>feedback to system: attach images, tag installed parts in 4D model </li></ul></ul><ul><li>Office solutions </li></ul><ul><ul><li>presentation techniques for augmented 4D models </li></ul></ul>
    25. 25. <ul><li>“ Mobile AR for Architects, Communities, Ads and Things” </li></ul><ul><li>Technology – core solutions </li></ul><ul><ul><li>ARPhone – products, things downloaded by matrix codes, augmented in camera phone view </li></ul></ul><ul><ul><li>ARMobile/AROnSite – products, things positioned in Google Earth maps, augmented in camera phone view </li></ul></ul><ul><ul><li>ARCipher – 3D content augmented to ads, products etc., based on visual tracking of matrix codes </li></ul></ul><ul><li>Applications (“Things”) </li></ul><ul><ul><li>Consumer products, furniture, decoration </li></ul></ul><ul><ul><li>Construction, houses, appartments </li></ul></ul><ul><ul><li>Augmented ads, packages, products </li></ul></ul><ul><ul><li>Entertainment, infotainment, games </li></ul></ul><ul><ul><li>Fashion, trends, digital arts </li></ul></ul><ul><ul><li>Personal digital items </li></ul></ul><ul><ul><li>Virtual brand products </li></ul></ul><ul><ul><li>Sharing by communities </li></ul></ul>Project Proposal “MARACAT”
    26. 26. Connecting Physical and Digital Worlds <ul><li>Mobile Augmented Reality as visual interface to location based (3D) Internet content </li></ul><ul><li>Internet content augmented in real world </li></ul><ul><ul><li>“ Google Earth on Earth” for displaying GE content on spot </li></ul></ul><ul><ul><li>E.g. virtual ads, tourist info, navigation, architecture </li></ul></ul><ul><li>Mobile Internet content creation </li></ul><ul><ul><li>Augmented and other media on camera phones, e.g. photos, video clips </li></ul></ul><ul><ul><li>Attaching the user generated (augmented) content to real world locations </li></ul></ul><ul><li>Interfaces to virtual products </li></ul><ul><ul><li>Digital products by virtual communities, with real monetary value </li></ul></ul><ul><ul><li>Current examples Habbo Hotel, IRC Gallery, Aapeli, Second Life, … </li></ul></ul><ul><ul><li>MAR interface to hyperdragging </li></ul></ul><ul><li>Interfaces to virtual worlds </li></ul><ul><ul><li>E.g. virtual world avatars augmented in real world </li></ul></ul><ul><ul><li>And, real people, things augmented in virtual worlds </li></ul></ul>
    27. 27. Mobile Augmented Reality one of the technologies “most likely to alter industries, fields of research, and the way we live” . - MIT’s annual review “10 Emerging Technologies 2007”
    28. 28. Technology Enablers and Drivers <ul><li>Smart mobile terminal </li></ul><ul><ul><li>Technology convergence to smart phones </li></ul></ul><ul><ul><li>Incl. camera, 3D graphics, WLAN, WiMAX, 4G </li></ul></ul><ul><ul><li>Up to accelerometers, RFID, 3D displays </li></ul></ul><ul><ul><li>E.g. N95, iPhone, Samsung </li></ul></ul><ul><li>Minituriarised data glasses </li></ul><ul><ul><li>E.g. Lumus augmented reality glasses </li></ul></ul><ul><ul><li>MyVu video glasses for iPod </li></ul></ul><ul><li>Game industry, e.g. </li></ul><ul><ul><li>Sony Eye Toy </li></ul></ul><ul><ul><li>Nintendo Wii </li></ul></ul><ul><ul><li>Eye of Judgment </li></ul></ul><ul><li>AR software technology </li></ul><ul><ul><li>E.g., Markerless tracking (see video ) </li></ul></ul><ul><ul><li>Commercial activities, companies Intersense (USA), Metaio (Germany), Total Immersion (France) </li></ul></ul>
    29. 29. Mixed Reality and 3D Web <ul><li>Second Life etc. </li></ul><ul><ul><li>Virtual communities and commerce </li></ul></ul><ul><ul><li>Avatar representations & access from real world by Mixed Reality </li></ul></ul><ul><li>Google Earth </li></ul><ul><ul><li>Incl. 3D buildings, photos, panorama, etc. </li></ul></ul><ul><ul><li>Content creation by virtual communities, “digital graffiti” </li></ul></ul><ul><li>Microsoft </li></ul><ul><ul><li>PhotoSynth, Massively multi-user content creation </li></ul></ul><ul><ul><li>3D reconstruction of physical world </li></ul></ul><ul><li>Nokia </li></ul><ul><ul><li>Purchase of Navteq at 5 Billion € </li></ul></ul><ul><ul><li>MARA project & VCUI team work at Palo Alto 2007 </li></ul></ul><ul><li>IBM </li></ul><ul><ul><li>International Herald Tribune (April 25, 2007): IBM creates a mainframe platform for Virtual Worlds with game developer Hoplon, using the high-powered Cell processor, capable of supporting 100.000’s of users in realistic 3D games ... </li></ul></ul>
    30. 30. Thank You! Prof. Charles Woodward Videos and Demos available at: