A talk from the Enterprise 2 Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Leif Oppermann (Fraunhofer FIT): AR In and Around Buildings Based on building data gained from Building Information Modelling (BIM) and related processes, this talk presents building-related AR application prototypes that have been recently tried and tested in and around buildings. Following up on our last year's presentation about visualising virtual buildings in their real environment from the outside with Auto AR, this talk is now going inside. Using indoor AR with smart glasses and tablets, and utilising actual BIM and furniture 3D models, we developed and studied building services and interior design applications in our own building. This talk reports on key findings from this study, e.g. how the applications were perceived by users as a fit for the particular devices. Finally, we also report on a new project about automated space measurement for buildings where no BIM data is available, and how to combine that with material recognition and AR views. http://AugmentedWorldExpo.com

1. © Fraunhofer Institute for Applied Information Technology FIT
Dr. Leif Oppermann, Head of Mixed and Augmented Reality Solutions
Seite 1
AR IN AND AROUND BUILDINGS

2. © Fraunhofer Institute for Applied Information Technology FIT
Fraunhofer FIT
n Fraunhofer is the largest organization for applied research in Europe
n 72 institutes, 25.000 employees
n Invented MP3 Audio Compression
n Fraunhofer Institute for Applied Information Technology FIT
n Human-centered computing
n Cooperation systems
n Located on Institute Center Birlinghoven
n Since 1968 one of the largest German centers
in IT and applied mathematics
n 50 years of human-centered digitalisation
n 20+ years of AR / MR / XR / WhatevR
Seite 2
Old buildings need renovation

3. © Fraunhofer Institute for Applied Information Technology FIT
Getting AR outside in the 2000s
Seite 3
n From enhanced rooms
n To buildings
n To the campus
n Into the city
n From marker to GPS & compass
Architecture (ARTHUR)
Building Maintenance (CoSpaces)
Pervasive Gaming, Crossmedia Gaming, mobile AR (IPerG)
Mobile AR in the City (IPCity)

4. © Fraunhofer Institute for Applied Information Technology FIT
Seite 4
Visualising Building Models (Auto AR) Models courtesy of FIDUCIA

5. © Fraunhofer Institute for Applied Information Technology FIT
Getting back inside with 3D building models
Seite 5
Models courtesy of IZB.LD

6. © Fraunhofer Institute for Applied Information Technology FIT
Unique opportunity : planned construction
n Complete set of building models
n Rooms
n Pipes and supply engineering
n Various studies and theses
n Different applications
n Different devices
n Technology tests
n Indoor tracking
n User acceptance
Seite 6

7. © Fraunhofer Institute for Applied Information Technology FIT
During construction
Seite 7
HUB conference, Berlin 2016

8. © Fraunhofer Institute for Applied Information Technology FIT
Seite 8

9. © Fraunhofer Institute for Applied Information Technology FIT
n Experiencing interior design and 3D models
n Spatial impression even during construction
n Done in cooperation with Vario
Adding furniture
Seite 9

10. © Fraunhofer Institute for Applied Information Technology FIT
Seite 10

11. © Fraunhofer Institute for Applied Information Technology FIT
Study of collaborative indoor AR
n In a realisitic scenario
n Real building
n Real data
n Collaborative tasks
n 1.) Building maintenance
n 2.) Interior design / furniture
n Making decisions, discussing placements, etc.
n Hand-held (Tango tablet) vs. hands-free (HoloLens)
n Which device is preferred for which task?
Seite 11

12. © Fraunhofer Institute for Applied Information Technology FIT
Setup
n 16 participants in groups of 2
n Architects, researchers, student assistants
n 14 male, 2 female
n 10 unfamiliar with the devices
n Four tasks
n Two on tablet
n Two on smart glasses
n Questionnaires and interviews
n Live-observer and video-observer
n About 30-45 per test-run
Seite 12

13. © Fraunhofer Institute for Applied Information Technology FIT
Results 1/2
Seite 13

14. © Fraunhofer Institute for Applied Information Technology FIT
Results 2/2
n Tango Tablet clearly favoured in our study
n More familiar interaction, handy device
n Eases face to face discussion
n Sadly, Tango has been discontinued…
n … and ARCore doesn‘t support Area Learning (yet?)
n Findings for remote collaboration would likely differ
Seite 14

15. © Fraunhofer Institute for Applied Information Technology FIT
New cooperation with Voxelgrid
Seite 15
n What if …
n You don‘t have 3D plans
n Don‘t want to model from scratch (too expensive)
n But need digital floorplans?
n Simple walk through with custom rig, lots of processing
n Combination of LIDAR, Photogrammetry, Deep Learning
and Hyperspectral Imaging
n Then doing AR / MR / XR / WhatevR on that

16. © Fraunhofer Institute for Applied Information Technology FIT
… to be continued
n Leif Oppermann
n Fraunhofer FIT
Schloss Birlinghoven
53754 Sankt Augustin
n http://www.fit.fraunhofer.de/mars
Seite 16