AR for the Visually Impaired: Pathfinding Workshop (AugSense)

•Download as PPTX, PDF•

1 like•253 views

A talk from the Life Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017. AR for the Visually Impaired: Pathfinding Workshop (AugSense) Chris Fornof, Co-Founder, AugSense Neil Orgon, Lead Developer, AugSense Curtis Holsinger, Cofounder, CEO, AugSense AR for the Visually Impaired: Pathfinding Workshop (AugSense) 1. Intro to challenges faced by visually impaired 2. Current Solutions (and their limitations/problems) 3. Building better solutions (UX design for visually impaired) 4. Putting V.I. design in your programs - designing for accessibility 5. Pathfinding & spatial navigation (and why it's so important) 6. Algorithms & industry overview - what's next for AR, and what that means for Visually Impaired users. http://AugmentedWorldExpo.com

Technology

Join the conversation @ARealityEvent & #AWE2017
Pathfinding: AR for
the
Visually Impaired
A Sensory Workshop

• Severe Loss of Vision
• Not Fully Correctable
Visual
Impairment
Join the conversation @ARealityEvent & #AWE2017

• Loss of ability to function
• Dependence on family/friends
• Higher likelihood of unemployment
Visual Impairment
Means…
Join the conversation @ARealityEvent & #AWE2017

Join the conversation @ARealityEvent & #AWE2017
Assistive Devices,
Medical Treatments,
and AR

• Guide Canes
• Guide Dogs
• Magnification
programs/devices
Visual/Audio
Aids
Join the conversation @ARealityEvent & #AWE2017
• Audio Cue Devices
• Text-To-Speech
(TTS)

FUTURE
• CRISPR
• Full eye transplant
Medical/Technological
Treatments
Join the conversation @ARealityEvent & #AWE2017
NOW
• Lasik
• Corneal Transplant
• Retinal Implant

Using AR to Improve Sensory
Input
Join the conversation @ARealityEvent & #AWE2017
1. Augment/Improve Visual Input
2. Augment a Support Sense (Hearing,
Touch)
3. Augment/Combine Sensory Input

• OLED camera headset
• Maximizes peripheral vision
• Bioptic Tilt
Augmenting Vision
Join the conversation @ARealityEvent & #AWE2017

• Replaces Canes, Guide Dogs
• Addresses many visual issues
- Color blindness
- Highlight edges of objects
Augmenting Vision
Join the conversation @ARealityEvent & #AWE2017

• Different tones for object
detection and location
• Vibration feature through phone
AR using Haptic, Audio Cues
Join the conversation @ARealityEvent & #AWE2017

• Audio and Visual cues
• Pathfinding
• Obstacle Detection
• Depth Perception
AR with Combined Sensory
Cues
Join the conversation @ARealityEvent & #AWE2017

Combining Senses
Join the conversation @ARealityEvent & #AWE2017

• Wide Variety of Visual Impairments
• Difficult to Address with Only One
Augmented Sense
Why Combine Senses?
Join the conversation @ARealityEvent & #AWE2017

• Scan Surroundings
• Intelligently Interact
with the Environment
What Developers Can Work
With
Join the conversation @ARealityEvent & #AWE2017

• Multiple Types of Feedback
• Customize User Experience
• Design for Color Blindness
• Design for Peripheral Vision
New Design Guidelines
Join the conversation @ARealityEvent & #AWE2017

• Obstacle Detection
• Custom Video and Audio
Packages
Design Examples
Join the conversation @ARealityEvent & #AWE2017

• Multiple Color Palette Options
• Customized Heads Up Display
Design Examples
Join the conversation @ARealityEvent & #AWE2017

Pathfinding
Join the conversation @ARealityEvent & #AWE2017

• Analyze the Environment
• Safely Navigate Familiar Spaces
• Intelligently Explore New Spaces
Navigation
Join the conversation @ARealityEvent & #AWE2017

• Some Users are Visually Impaired
• Combined Senses Improve AR
• Augment for Everyone
Final Thoughts
Join the conversation @ARealityEvent & #AWE2017

THANK YOU!
Join the conversation @ARealityEvent & #AWE2017

Similar to AR for the Visually Impaired: Pathfinding Workshop (AugSense)

This overview presentation was used at Ecobuild 2017. Gathering Evidence for Built Environment Design Towards better Care Environments for Ageing BESiDE [The Built Environment for Social inclusion through the Digital Economy] was a multidisciplinary research group. Led by Professor Vicki Hanson, we included researchers from Computing, Design, and Healthcare at the University of Dundee and from Computing at Newcastle University. We carried out research in care homes to help tackle a key challenge facing care designers and providers: Understanding how to create environments which support older adults in maintaining their quality of life long after transitioning to a care home environment. We worked across different areas: giving a voice to the users of these environments, measuring physical activity in relation to health, and tracing and modelling movement within the homes to generate new research knowledge.

BESiDE Built Environment for Social Inclusion through the Digital Economy

Ian Ruaraidh Harrison

Av aids

karansmriti

Audibility & linear hearing instruments

Lynn Royer

Keynote iGBL Conference. Digital Me. A Revolutionary Game-Based Method to Off...

Paul Pivec

You are probably familiar with the requirements of Americans with Disabilities Act (ADA) and the Architectural Barriers Act (ABA) for physical accessibility in your institution. But how do you bring exhibits alive to create inclusive experiences that meet the needs of visitors with a wide range of cognitive and sensory differences? In a lively, interactive format, this panel of exhibit designers present the philosophy, strategies, and specific techniques of audio description, tactiles, and electronic media to create displays that make exhibit content accessible to the broadest audience possible. Moderator: Jill Rullkoetter, Senior Deputy Director, Frye Art Museum Presenters: Charles Davis, AIA, Principal, EDX Exhibits Lyn Henley, President, Henley Company Design and Production Daniel Quan, Owner, Daniel Quan Design

Using Common Senses: Programmatic Accessibility for Exhibits

West Muse

EarTouch: Turning the Ear into an Input Surface

sugiuralab

A full and rich experience is one that engages all the senses and emotions. L+W use design research and their skillsets to choreograph tactile materials and surfaces, smart design details and technical solutions, body postures, user behaviours, relationships between users and users with their contextual environment. In their presentation, they will drive you through the processes behind the discoveries and the outcomes of Pediatric Waiting Experiences, New Chromatherapy Spa Services, VIP helicopter interior and other relevant projects.

Keynote #4 transformative tangibles by francesca lanzavecchia and hunn wai

ux singapore

iPads For the Ronald McDonald Learning Program

Spectronics

User experience and accessibility best practice by sigma 11.07.2019

Nexer Digital

Get Comfortable with Visual Aids

Claire moava Sherrington

Accessible and Interactive eLearning - Not mutually exclusive.

Garima Gupta , CTDP

Multi-Sensory Design, Transmedia Inclusive Storytelling (Meet The Media Guru)

Corey Timpson

Sound Design

Ricardo Salema

A talk from the Develop Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017. Ryan Damm (Visby): Light Fields & Polygons: Making Sense of New Image Formats Augmented and Virtual Reality displays have tremendous potential, but to unlock their true power they require a revolution in imaging and visualization. Going beyond 2D images, these displays have to potential to leverage 3D 'volumetric' representations, as well as 4D light fields, to display visually richer scenes. This session will examine the range of imaging options today, including their strengths and weaknesses. We'll also cover the likely developments in the near future, and how these developments will impact different verticals. http://AugmentedWorldExpo.com

Ryan Damm (Visby): Light Fields & Polygons: Making Sense of New Image Formats

AugmentedWorldExpo

Applied AI Community

AI Leadership Institute

The June instalment of "The Juice" breakfast series, sponsored by the Synergy Centre, Institute of Technology Tallaght: presentation on industrial design by Dr Toby Scott. Toby was founding director of the Centre for Design Innovation (www.designinnovation.ie), a Director of the Design Council in the UK (www.designcouncil.org.uk) and is currently helping to establish a Centre for Design Innovation in Scotland. Toby is now taking the learning from these roles and applying them through an international business school that places design-thinking at the heart of business success (www.pentaclethevbs.com). He is passionate about innovation within small and medium sized companies and helps develop concrete ideas that are affordable and work in practice.

Toby Scott Design for Innovation

una coleman

A talk from the Design Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017. Aaron Pulkka (Two Bit Circus): Storycrafting in VR, AR, and Mixed Reality While "storytelling" implies there is a preordained story to be told, "storycrafting" embraces the notion that a story's consumer can be an active participant in it's creation. During this session Aaron will share his experiences with immersive storycrafting in VR, AR, and Mixed Reality from entertainment to education as well as a vision for the future. http://AugmentedWorldExpo.com

Aaron Pulkka (Two Bit Circus): Storycrafting in VR, AR, and Mixed Reality

AugmentedWorldExpo

AUTHENTIC IN ALL CAPS is an award-nominated web audio adventure for the iPad (with a Chrome App version coming soon!). You travel across the web with characters who face ridiculous obstacles to being themselves. It is inspired by audio drama, audio tours, and alternate reality games...and it's about identity, mortality, and pizza toppings... This case study and interview gives you a behind the scenes look at the creation of this innovative narrative experience.

AUTHENTIC IN ALL CAPS Case Study & Interview with Christy Dena

TMC Resource Kit

Chapter 7 presentation skills

dantares

From Aha! to Eureka Smartees Seminar

InSites on Stage

Similar to AR for the Visually Impaired: Pathfinding Workshop (AugSense) (20)

BESiDE Built Environment for Social Inclusion through the Digital Economy

Av aids

Audibility & linear hearing instruments

Keynote iGBL Conference. Digital Me. A Revolutionary Game-Based Method to Off...

Using Common Senses: Programmatic Accessibility for Exhibits

EarTouch: Turning the Ear into an Input Surface

Keynote #4 transformative tangibles by francesca lanzavecchia and hunn wai

iPads For the Ronald McDonald Learning Program

User experience and accessibility best practice by sigma 11.07.2019

Get Comfortable with Visual Aids

Accessible and Interactive eLearning - Not mutually exclusive.

Multi-Sensory Design, Transmedia Inclusive Storytelling (Meet The Media Guru)

Sound Design

Ryan Damm (Visby): Light Fields & Polygons: Making Sense of New Image Formats

Applied AI Community

Toby Scott Design for Innovation

Aaron Pulkka (Two Bit Circus): Storycrafting in VR, AR, and Mixed Reality

AUTHENTIC IN ALL CAPS Case Study & Interview with Christy Dena

Chapter 7 presentation skills

From Aha! to Eureka Smartees Seminar

More from AugmentedWorldExpo

A talk from the Training & Education Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Bill Meyer (Virtual Science Center): Turning Kids on to STEM by Letting Them Discover How VR and AR Tricks Our Brain How exactly does Virtual and Augmented Reality game human perception so things we know aren’t there seem to exist? Can simple and robust public learning experiences empower and delight people of all ages to experiment and discover the answers for themselves? The answer is yes. This talk will present examples and discuss how UX best practices can be applied to create effective inquiry-based learning experiences that unpack seemingly complex modern technologies. Through iterative design coupled with repeated visitor testing, we deconstructed the surprising perceptual science and technology behind VR and AR into 16 cool hands-on experiences that spark “aha” moments and minimize the need for wordy explanations. We keep concepts intuitive, playful, and fun to understand. Our traveling exhibition goal is to show visitors they're smarter than they suspect, inspire students to aim for STEM careers, and help teachers lead deeper NGSS and Common Core dives both in and out of the classroom. This 45 second video shows an example exhibit and part of our visitor testing process: https://youtu.be/Sgh0Sys57lY Without needing to learn the terms, visitors discover the secrets of how things like Motion Parallax, Stereo Vision, 3D Audio Spatialization, Outside-In, and Inside-Out Tracking work in concert to make virtual, augmented and mixed reality experiences possible. https://awexr.com

Bill Meyer (Virtual Science Center): Turning Kids on to STEM by Letting Them ...

AugmentedWorldExpo

A talk from the Gaming & Entertainment Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Nick Klingensmith (Microsoft): Increasing Immersion with the MR Lighting Tools To-date, most 3D graphics have been rendered on opaque displays. Now, not only are we putting holograms into the real world, but we're also doing it on additive displays! How do we render holograms that look good in this environment, and how do we make them look like they belong? The Mixed Reality Lighting Tools are a collection of easy Unity based solutions, from replicating your environment's lighting, to casting believable additive shadows. Come find out how easy it is to make your Mixed Reality application more immersive! https://awexr.com

Nick Klingensmith (Microsoft): Increasing Immersion with the MR Lighting Tools

AugmentedWorldExpo

A talk from the Creator Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Rokid: Design a seamless solution for AR glasses Qi Xiong | Rokid Paris Fan | Rokid Nan Wang | Rokid Gonglue Jiang | Rokid In this talk, we will discuss how Rokid creates a seamless AR experience from two aspects: ergonomic design(hardware) and systematic UI/UX design(software). The presentation will also share the insights of the entire product development cycle of Rokid Glass: from crafting product appearance with strict constraints, deploying user interfaces on a new and unique AR device, to the case studies and progressive design of real implementations. The talk offers a glimpse of the future AR design methodology by demonstrating the superpower enabled by design thinking. Rokid Glass is an AI-enabled, all-in-one AR glasses already in mass production, with seamless user experience which widely adopted by the industry. https://awexr.com

Rokid: Design a seamless solution for AR glasses

AugmentedWorldExpo

A talk from the Marking & Sales Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Tom De Vos | Fat Boy Dalia Lasaite | CGTrader Augmented Reality is having a profound impact on the way people shop online. By enabling consumers to interact with and try products before purchasing as they would in a brick and mortar store, Augmented Reality has been proven to increase sales conversions, reduce product returns and extend online engagement. This presentation will examine the latest technologies, trends and strategies for deploying AR for e-Commerce. https://awexr.com

How AR is Transforming the Online Retail Experience

AugmentedWorldExpo

A talk from the Enterprise Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Chloe Doyeon Kim (MAXST): The Current and Future State of MAXST Platform MAXST, a persistent challenger, is proudly specialized in Augmented Reality working with prominent Korean enterprises, such as Hyundai, Samsung Display, Samsung Electronics, and KT. MAXST’s cloud-based AR platform pursues innovation in terms of AR development tools, AR production costs, and profitability. We also believe Visual SLAM is critical basis for Future AR. We will reveal our stories and insight to the immersive world of today and tomorrow. https://awexr.com

Chloe Doyeon Kim (MAXST): The Current and Future State of MAXST Platform

AugmentedWorldExpo

A talk from the Start-up Pitch Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Owning Augmented Space Neil Mandt | The Layer Group Brian Wassom | Warner Norcross + Judd LLP "How can I own the AR 'air rights' around my physical property?" This may be the most commonly asked legal question around AR content. It is gaining new momentum and importance today, as location-based AR finally turns a profit, and as the quest for the Open AR Cloud takes shape. Finding the answers requires crossing the boundaries of multiple legal disciplines and practical concerns, and will not always be easy. This session will equip you to understand the legal risks and give you strategies to protect the integrity of both physical space and digital expression. https://awexr.com

AWE USA 2019: Owning Augmented Space

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Victor Sun (Shadow Creator): How to turn Mixed Reality “headset” into “glasses”? Microsoft has released HoloLens 2 on MWC. I think it is the benchmark for mixed reality devices, but it only reaches the pass mark. In order to be used by ordinary consumers, headsets must be turned into glasses to eliminate their fears of tech equipment. https://awexr.com

Victor Sun (Shadow Creator): How to turn Mixed Reality “headset” into “glasses”?

AugmentedWorldExpo

Chris Pickett (DigiLens): XR is Hard: Here’s Why

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Antti Sunnari (Dispelix Ltd): Full-color, single-waveguide near-eye displays for AR glasses and MR headsets For years, many have tried to develop a see-through, near-eye display technology that combines beautiful design, excellent image quality and scalable mass production with high yields. At Dispelix, we’ve figured it out. Dispelix is helping product companies to create beautiful AR glasses based on single-waveguide full-color displays with superior image quality and mass manufacturability. https://awexr.com

Antti Sunnari (Dispelix Ltd): Full-color, single-waveguide near-eye displays ...

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applications AI/AR industry has attracted attention never seen before of academia and industry, into which numerous talents and resources have been invested. However, academic achievements are not equal to products, which need to be adjusted and optimized in technology, engineering, product, etc. according to specific application scenarios. This talk will share with you some difficulties, misconceptions and experience in commercializing AR based on HiScene’s practice. https://awexr.com

Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...

AugmentedWorldExpo

A talk from the Gaming & Entertainment Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Augmented reality meets Television -Ellen DeGeneres' Game of Games AR App Daniel Leary | The Ellen DeGeneres Show Alexa Hook | The Ellen DeGeneres Show Paul Hake | HitPoint Inc. Ellen DeGeneres, America's most loved comedian and popular TV host, entered the augmented reality era with the "Game of Games" show. Over 900,000 app users get to tune in and play along with Ellen with AR by unlocking prizes that jump from the TV screen into viewers' phones. The app has hit 741,614 AR gift box markers scanned from NBC broadcasts of Game of Games, during the weekly Play Along Live game. At AWE, HitPoint Studios gives an insight into the creative and technical process of building the "Game of Games" Game app and how to connect traditional TV shows with AR technology. https://awexr.com

Augmented reality meets Television -Ellen DeGeneres' Game of Games AR App

AugmentedWorldExpo

Jennifer Cook (Dreamscape Immersive): Dreamscape Immersive Presentation

AugmentedWorldExpo

A talk from the Enterprise Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. 2 Partners sharing 1 vision for smart operators Mark Fleischer | AMA XPERTEYE INC. Peter Verstraeten | Proceedix The partnership between XpertEye and Proceedix offers a best-in-class solution to empower smart operators and technicians. The combination leverages both mobile technology and smart glasses for remote assistance and instruction and inspection execution. https://awexr.com

AWE USA 2019: 2 Partners sharing 1 vision for smart operators

AugmentedWorldExpo

Phil LaFond (Bosch Automotive Service Solutions Inc.): Bosch Technical Traini...

AugmentedWorldExpo

A talk from the Main Stage at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Scott Montgomerie (Scope AR): AR’s Influence on the Workforce of Tomorrow: Job Eliminator or Creator? As the speed of technology continues to accelerate automation in the manufacturing world, the inevitable question of whether or not the “human touch” will become obsolete is top of mind for workers. The fear that robots and smart technologies will take everyone's jobs is prevalent, but not necessarily true. AR has the power to be a job creator, not a job eliminator. Its ability to make anyone an instant expert can in fact increase job security by quickly helping workers become more proficient in tasks. Learn about real-world use cases where AR is making people better, and safer, at their jobs, and explore why enterprises who create a workplace that’s augmented, not automated, will be the leaders of tomorrow. https://awexr.com

Scott Montgomerie (Scope AR): AR’s Influence on the Workforce of Tomorrow: Jo...

AugmentedWorldExpo

A talk from the Main Stage at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Hugo Swart (Qualcomm, Inc.): How 5G, Distributed Processing and Technology Advancements are Accelerating the Timeline to a Ubiquitous XR World XR has the potential to become one of the world’s most disruptive computing platforms in the coming decade. Over the past year, we’ve seen significant strides in technology and with the introduction of new XR form factors such as standalone, tethered viewers and dual-mode HMDs – there has been an acceleration of XR opportunities, use cases and adoption. In this keynote presentation, Hugo Swart, Head of XR at Qualcomm Technologies, Inc. will speak to cutting-edge technological developments and how Qualcomm has met previous challenges, with a forward outlook on how strong ecosystem collaboration, the proliferation of 5G and AI will fast-track the industry timeline to an XR ubiquitous world. https://awexr.com

Hugo Swart (Qualcomm, Inc.): How 5G, Distributed Processing and Technology Ad...

AugmentedWorldExpo

A talk from the Creator Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Valentin Heun (PTC): One Reality - A 3rd generation AR User Interface Many of our technological innovations seem to expand the computational abilities without the human in the loop. Augmented Reality is one of the view technologies that promises technological advances that enable us humans a better connection with the ubiquitous technology around us. We are not there yet to make use of such a user interface. We currently have individual islands of interactivity via AR. This conference may have many spatial demos as well, however, a single ubiquitous layer that penetrates all screens, surfaces, machines, and environments are not available. This is what the PTC Reality Lab researches. The core of this research is the ability to use AR in a scalable distributed platform to bridge among technological domains to allow the weaving of multiple technologies into one user experience. The resulting user experience is called One Reality. The goal for One Reality is to provide one seamless, ubiquitous flow of user experience for all technologies that touch the user’s decision making. This talk will iterate on the different stages of Augmented Reality User Interfaces and identifies One Reality as the 3rd stage in the evolution of AR user interfaces. This visionary talk aims to inspire the audience to think beyond the known applications for Augmented Reality. https://awexr.com

Valentin Heun (PTC): One Reality - A 3rd generation AR User Interface

AugmentedWorldExpo

A talk from the Training & Education Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Anton Ebert (Siemens Healthcare): Challenges and approaches on integrating a cutting edge technology in modern healthcare businesses This session will provide insights and a basis for further discussions on how technologies like Augmented and Virtual Reality are being tested and explored in the healthcare sector. https://awexr.com

Anton Ebert (Siemens Healthcare): Challenges and approaches on integrating a ...

AugmentedWorldExpo

A talk from the Humanities Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Sarah Hill (Healium by StoryUP Studios): Healing Stories Powered by Biometrics Users aren't just watching your content, they're feeling it with their wearables. Brain patterns and heart rate are XR storytelling's new inputs. Peek inside the world's first VR & AR content channel powered by a brain-computer interface and heart rate to learn about a new study on XR's therapeutic impact on anxiety. https://awexr.com

Sarah Hill (Healium by StoryUP Studios): Healing Stories Powered by Biometrics

AugmentedWorldExpo

A talk from the Humanities Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Iva Leon (ARVR Women and Allies): Building community with social VR Social VR platforms like Facebook Spaces can help community builders and purpose-driven organizations innovate the way they engage their members and bring people together. Find out how ARVR Women uses social VR to elevate the visibility of their members and add value to the group. https://awexr.com

Iva Leon (ARVR Women and Allies): Building community with social VR

AugmentedWorldExpo

More from AugmentedWorldExpo (20)