It's an extremely exciting time in automotive, with major advances underway in assisted driving, ride-sharing, electrification and more. And cars themselves are evolving beyond just transportation, with the passenger's digital experience becoming of equal importance to the vehicle's exterior design or mechanical performance. In this session – which showcases projects from Nissan, Honda, Mattel, and the LA Auto Show – learn how Unity's flexibility allows users to create powerful augmented (AR) and mixed reality (MR) applications for a wide variety of use cases, including enterprise tools that let global design teams collaborate in real-time, hot marketing apps that transform consumers' in-dealership experience, and AR/MR/VR apps for imagining the future of transportation. Danny Parks - Trigger Global Jason Yim - Trigger Global

1. Creating powerful Mixed Reality Experiences
across Auto

2. JASON YIM
• Born in Singapore > Grew up in Hong Kong
• UCLA Graphic Design Major
• Started Trigger in 2005
• 4 patents in AR
CEO
Jason@triggerglobal.com
DANNY PARKS
• USC Electrical Engineering Major
• Joined Trigger in 2013
• 100+ MR projects
SENIOR DIR OF TECH
danny@triggerglobal.com

4. ANTHONY
Check logos

5. Overview

6. Design & Development
Opportunities
• Volumetric design review
• Annotation and remote collaboration
• Design validation by executives

7. Manufacturing
Opportunities
• Training
• Complex Assembly
• Field and Remote Assistance
• Maintenance

8. Functions and Features
Opportunities
• HMI visualization
• Driver Dash and Panels
• HUD
• Passenger rear seat and window displays
• External displays

9. Sales and Marketing
Opportunities
• Snap, Facebook, WeChat and other social AR content
• Consumer advertising and marketing
• Sales training
• Sales communication at retail

10. Ownership Experience
Opportunities
• CRM through apps and digital channels
• User maintenance
• Infotainment
• Loyalty system for owners

11. Case Study | Design & Development

15. Review Mockup Design
Sketches > 3D > Volumetric > Full Final
Automotive
Design
Funnel

16. Review Mockup Design
Sketches > 3D > Volumetric > Full Final
CLAY Model
Automotive
Design
Funnel

17. 6DOF tape
Multiple simultaneous users
Mixed reality annotation
• Co-developed with Honda Advanced Design, the AR design
evaluation tool replaces the traditional clay model with a
volumetric digital model to reduce time spent from 8-weeks to
a matter of days
• Vehicles can be compared outdoors and life-size in different
versions of the tool: Microsoft HoloLens, Apple ARKit,
Windows Mixed Reality and now in Magic Leap
• Designers can rotate the vehicle, change its color, view the
interior, turn on the lights, examine the vehicle specifications
and compare two vehicles
• Trigger owns the engine and tech IP behind the tool

19. Technical Breakdown
• 3D Pipeline has improved - CAD to mobile
• Environment maps update at run time
• Different devices - displays, inputs, form factors
• Barriers are physical not digital

20. Case Study | Sales and Marketing

21. • A revolutionary, ambassador-driven sales tool that uses AR to educate customers on the latest Nissan
Intelligent Mobility technologies featured in the 2018 models of the Nissan Rogue, Maxima and TITAN
• Featured at the 2017 LA Auto Show and showcased in over 1,100 Nissan dealerships across North
America
• Customers touch the device to the physical car via an NFC tag located on one of the three vehicle’s, then
watch as Google Tango maps the augmentations to the vehicle in 360º. perfectly transitioning it into a
Star Wars/Nissan hybrid craft
• Iconic Star Wars characters come to life to demonstrate the Nissan Intelligent Mobility technologies,
including ProPilot Assist, Automatic Emergency Braking, Blind Spot Warning and Rear Cross Traffic Alert

23. Technical Breakdown
• Replace a full size car perfectly - model targets not really a thing yet
• Tango tracks really well, but doesn’t know where anything else is
• ILM effects on a mobile device - why I hate holograms
• Story telling at scale

24. Case Study | Ownership experience

25. • VR in car - a partnership with Honda and DreamWorks Connected Travel Platform
• Showcased at Honda booth at CES 2017
• Directions, Mapping, POI data and transactions in VR + in-car game and entertainment
experience featuring DreamWorks’ Trolls
• In-car technology syncs car’s telematics and motion with the virtual environment
• Selected as a CES Top Pick by Kidscreen

27. Technical Breakdown
• Tracking a vehicle in a city - GPS is miraculous, but not that miraculous
• There’s a lot of data in a city - not all of it perfect
• Maps are still largely 2D representations
• Cars are a difficult environment for VR

28. Case Study | Bonus!

29. • Mattel’s flagship Mixed Reality toy for holiday 2018
• Winner of multiple “Top 10 toys” at NYC Toyfair 2018
• Charged cars + LBE controlled track + AR gameplay
• Multi-player and single player vs AI racing

31. Technical Breakdown
• Connecting to the physical - BLE and model targets
• Local multiplayer - connecting players (and a track) together
• Don’t forget about the fun - paper, prototypes, and rebalancing
• Cars are accident prone - try not to lose them
• Future proofing - OTA firmware updates

32. Top 10 Takeaways
1.Things get harder when digital meets physical
2.Identify the pain points in existing processes - that’s where to innovate
3.Telling stories isn’t as important as solving problems - but it’s still
critical
4.Leverage existing data where you can - there’s a lot of it
5.Build systems to accept change - nothing stays the same
6.Make things pretty or consistent - artists see things differently
7.Take advantage of physical affordances and inputs - when it makes
sense
8.Context is king - “it depends…”
9.Be optimistic about technology - it will get better
10.Things get better when digital meets physical

33. Thank You!