Lecture 11 of the COMP 4010 class on Augmented Reality and Virtual Reality. This lecture is about VR applications and was taught by Mark Billinghurst on October 19th 2021 at the University of South Australia
Lecture 1 for the 2022 COMP 4010 course on AR and VR. This course was taught by Mark Billinghurst at the University of South Australia in 2022. This lecture provides an introduction to AR, VR and XR.
The final lecture in the 2021 COMP 4010 class on AR/VR. This lecture summarizes some more research directions and trends in AR and VR. This lecture was taught by Mark Billinghurst on November 2nd 2021 at the University of South Australia
Lecture 6 of the COMP 4010 course on AR/VR. This lecture is about designing AR systems. This was taught by Mark Billinghurst at the University of South Australia on September 1st 2022.
Lecture 8 of the COMP 4010 course taught at the University of South Australia. This lecture provides and introduction to VR technology. Taught by Mark Billinghurst on September 14th 2021 at the University of South Australia.
Lecture 2 in the 2022 COMP 4010 Lecture series on AR/VR and XR. This lecture is about human perception for AR/VR/XR experiences. This was taught by Mark Billinghurst at the University of South Australia in 2022.
Lecture 9 of the COMP 4010 course in AR/VR from the University of South Australia. This was taught by Mark Billinghurst on October 5th, 2021. This lecture describes VR input devices, VR systems and rapid prototyping tools.
Lecture 5 in the COMP 4010 class on Augmented and Virtual Reality. This lecture was about AR Interaction and Prototyping methods. Taught by Mark Billinghurst on August 24th 2021 at the University of South Australia.
Lecture 1 for the 2022 COMP 4010 course on AR and VR. This course was taught by Mark Billinghurst at the University of South Australia in 2022. This lecture provides an introduction to AR, VR and XR.
The final lecture in the 2021 COMP 4010 class on AR/VR. This lecture summarizes some more research directions and trends in AR and VR. This lecture was taught by Mark Billinghurst on November 2nd 2021 at the University of South Australia
Lecture 6 of the COMP 4010 course on AR/VR. This lecture is about designing AR systems. This was taught by Mark Billinghurst at the University of South Australia on September 1st 2022.
Lecture 8 of the COMP 4010 course taught at the University of South Australia. This lecture provides and introduction to VR technology. Taught by Mark Billinghurst on September 14th 2021 at the University of South Australia.
Lecture 2 in the 2022 COMP 4010 Lecture series on AR/VR and XR. This lecture is about human perception for AR/VR/XR experiences. This was taught by Mark Billinghurst at the University of South Australia in 2022.
Lecture 9 of the COMP 4010 course in AR/VR from the University of South Australia. This was taught by Mark Billinghurst on October 5th, 2021. This lecture describes VR input devices, VR systems and rapid prototyping tools.
Lecture 5 in the COMP 4010 class on Augmented and Virtual Reality. This lecture was about AR Interaction and Prototyping methods. Taught by Mark Billinghurst on August 24th 2021 at the University of South Australia.
Lecture 2 of the COMP 4010 class on AR/VR. This lecture is about the human perception system. This lecture was given on August 3rd 2021 by Mark Billinghurst from the University of South Australia.
Lecture 1 of the COMP 4010 course on AR and VR. This lecture provides an introduction to AR/VR/MR/XR. The lecture was taught at the University of South Australia by Mark Billinghurst on July 21st 2021.
Lecture 11 of the COMP 4010 class on Augmented Reality and Virtual Reality. This lecture is about VR applications and was taught by Mark Billinghurst on October 19th 2021 at the University of South Australia
Lecture 5 in the 2022 COMP 4010 lecture series. This lecture is about AR prototyping tools and techniques. The lecture was given by Mark Billinghurst from University of South Australia in 2022.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
Lecture 3 from the COMP 4010 course and Virtual and Augmented Reality. This lecture is about VR tracking, input and systems. Taught on August 7th, 2018 by Mark Billinghurst at the University of South Australia
Lecture 12 in the COMP 4010 course on AR/VR. This lecture was about research directions in AR/VR and in particular display research. This was taught by Mark Billinghurst on September 26th 2021 at the University of South Australia.
Lecture 7 from the COMP 4010 class on AR and VR. This lecture was about Designing AR systems. It was taught on September 7th 2021 by Mark Billinghurst from the University of South Australia.
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
A talk given by Mark Billinging in the CLIPE workshop in Tubingen, Germant on April 27th 2023. This talk describes how virtual avatars can be used to support remote collaboration.
Lecture 2 in the COMP 4010 AR/VR class taught at the University of South Australia. This lecture is about VR Presence and Human Perception. Taught by Mark Billinghurst on August 6th 2019.
Keynote speech given by Mark Billinghurst at the ISS 2022 conference. Presented on November 22nd, 2022. This keynote outlines some research opportunities in the Metaverse.
Lecture 10 in the COMP 4010 Lectures on AR/VR from the Univeristy of South Australia. This lecture is about VR Interface Design and Evaluating VR interfaces. Taught by Mark Billinghurst on October 12, 2021.
COMP 4010 Lecture12 - Research Directions in AR and VRMark Billinghurst
COMP 4010 lecture on research directions in AR and VR, taught by Mark Billinghurst on November 2nd 2017 at the University of South Australia. This is the final lecture in the 2017 COMP 4010 course on AR and VR
Lecture 3 in the 2022 COMP 4010 lecture series on AR/VR. This lecture provides an introduction for AR Technology. This was taught by Mark Billinghurst at the University of South Australia in 2022.
Lecture 6 on the COMP4010 course on AR/VR. This lecture describes prototyping tools for developing interactive prototypes for AR experiences. The lecture was taught on August 31st 2020 by Mark Billinghurst at the University of South Australia
Slides showing how to use Unity to build Google Cardboard Virtual Reality applications. From a series of lectures given by Mark Billinghurst from the University of South Australia.
COMP 4010 - Lecture 1: Introduction to Virtual RealityMark Billinghurst
Lecture 1 of the VR/AR class taught by Mark Billinghurst and Bruce Thomas at the University of South Australia. This lecture provides an introduction to VR and was taught on July 26th 2016.
COMP lecture 4 given by Bruce Thomas on August 16th 2017 at the University of South Australia about 3D User Interfaces for VR. Slides prepared by Mark Billinghurst.
Lecture 2 of the COMP 4010 class on AR/VR. This lecture is about the human perception system. This lecture was given on August 3rd 2021 by Mark Billinghurst from the University of South Australia.
Lecture 1 of the COMP 4010 course on AR and VR. This lecture provides an introduction to AR/VR/MR/XR. The lecture was taught at the University of South Australia by Mark Billinghurst on July 21st 2021.
Lecture 11 of the COMP 4010 class on Augmented Reality and Virtual Reality. This lecture is about VR applications and was taught by Mark Billinghurst on October 19th 2021 at the University of South Australia
Lecture 5 in the 2022 COMP 4010 lecture series. This lecture is about AR prototyping tools and techniques. The lecture was given by Mark Billinghurst from University of South Australia in 2022.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
Lecture 3 from the COMP 4010 course and Virtual and Augmented Reality. This lecture is about VR tracking, input and systems. Taught on August 7th, 2018 by Mark Billinghurst at the University of South Australia
Lecture 12 in the COMP 4010 course on AR/VR. This lecture was about research directions in AR/VR and in particular display research. This was taught by Mark Billinghurst on September 26th 2021 at the University of South Australia.
Lecture 7 from the COMP 4010 class on AR and VR. This lecture was about Designing AR systems. It was taught on September 7th 2021 by Mark Billinghurst from the University of South Australia.
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
A talk given by Mark Billinging in the CLIPE workshop in Tubingen, Germant on April 27th 2023. This talk describes how virtual avatars can be used to support remote collaboration.
Lecture 2 in the COMP 4010 AR/VR class taught at the University of South Australia. This lecture is about VR Presence and Human Perception. Taught by Mark Billinghurst on August 6th 2019.
Keynote speech given by Mark Billinghurst at the ISS 2022 conference. Presented on November 22nd, 2022. This keynote outlines some research opportunities in the Metaverse.
Lecture 10 in the COMP 4010 Lectures on AR/VR from the Univeristy of South Australia. This lecture is about VR Interface Design and Evaluating VR interfaces. Taught by Mark Billinghurst on October 12, 2021.
COMP 4010 Lecture12 - Research Directions in AR and VRMark Billinghurst
COMP 4010 lecture on research directions in AR and VR, taught by Mark Billinghurst on November 2nd 2017 at the University of South Australia. This is the final lecture in the 2017 COMP 4010 course on AR and VR
Lecture 3 in the 2022 COMP 4010 lecture series on AR/VR. This lecture provides an introduction for AR Technology. This was taught by Mark Billinghurst at the University of South Australia in 2022.
Lecture 6 on the COMP4010 course on AR/VR. This lecture describes prototyping tools for developing interactive prototypes for AR experiences. The lecture was taught on August 31st 2020 by Mark Billinghurst at the University of South Australia
Slides showing how to use Unity to build Google Cardboard Virtual Reality applications. From a series of lectures given by Mark Billinghurst from the University of South Australia.
COMP 4010 - Lecture 1: Introduction to Virtual RealityMark Billinghurst
Lecture 1 of the VR/AR class taught by Mark Billinghurst and Bruce Thomas at the University of South Australia. This lecture provides an introduction to VR and was taught on July 26th 2016.
COMP lecture 4 given by Bruce Thomas on August 16th 2017 at the University of South Australia about 3D User Interfaces for VR. Slides prepared by Mark Billinghurst.
COMP 4010 Lecture 5 on Interaction Design for Virtual Reality. Taught by Gun Lee on August 21st 2018 at the University of South Australia. Slides by Mark Billinghurst
COMP4010 Lecture 5 taught by Bruce Thomas at University of South Australia on August 24th 2017. This class was about using Interaction Design techniques for developing effective VR interfaces. Slides by Mark Billinghurst.
COMP 4010 Lecture 6 on Virtual Reality. This time focusing on Interaction Design for VR and rapid prototyping tools. Taught by Bruce Thomas at the University of South Australia on September 3rd 2019. Slides by Mark Billinghurst
Open Day activity for Computing @ University of East London.
This is a very cut down version of what students are going to study on their second year when taking Usability Engineering.
Introduction to usability evaluation methods & usability testing.
Website Usability & Eye-tracking by Marco Pretorious (Certified Usability Ana...DrupalCape
Things to consider when designing a website to make your site visitor's life easier!!
Note: There were some videos which were show to illustrate a point, however the presentation provides sufficient information and suggestion so you will not miss them.
UXD - A quick overview on what you need to work with your UX team Guilherme Rodrigues
The UXD team came up with a presentation, covering some of the point we have in our day to day work. Information architects, designers and front-end participated to build up this doc in order to practice and be more familiar with UCD process, agile project management, UX research and so on.
Have a look on the presentation and help us to build it up.
Similar to Comp4010 lecture11 VR Applications (20)
Keynote talk by Mark Billinghurst at the 9th XR-Metaverse conference in Busan, South Korea. The talk was given on May 20th, 2024. It talks about progress on achieving the Metaverse vision laid out in Neil Stephenson's book, Snowcrash.
These are slides from the Defence Industry event orgranized by the Australian Research Centre for Interactive and Virtual Environments (IVE). This was held on April 18th 2024, and showcased IVE research capabilities to the South Australian Defence industry.
This is a guest lecture given by Mark Billinghurst at the University of Sydney on March 27th 2024. It discusses some future research directions for Augmented Reality.
Presentation given by Mark Billinghurst at the 2024 XR Spring Summer School on March 7 2024. This lecture talks about different evaluation methods that can be used for Social XR/AR/VR experiences.
Empathic Computing: Delivering the Potential of the MetaverseMark Billinghurst
Invited guest lecture by Mark Billingurust given at the MIT Media Laboratory on November 21st 2023. This was given as part of Professor Hiroshi Ishii's class on Tangible Media
Empathic Computing: Designing for the Broader MetaverseMark Billinghurst
Keynote talk given by Mark Billinghurst at the CHI 2023 Workshop on Towards and Inclusive and Accessible Metaverse. The talk was given on April 23rd 2023.
Lecture 4 in the 2022 COMP 4010 lecture series on AR/VR. This lecture is about AR Interaction techniques. This was taught by Mark Billinghurst at the University of South Australia in 2022.
Empathic Computing and Collaborative Immersive AnalyticsMark Billinghurst
Short talk by Mark Billinghurst on Empathic Computing and Collaborative Immersive Analytics, presented on July 28th 2022 at the Siggraph 2022 conference.
Lecture given by Mark Billinghurst on June 18th 2022 about how the Metaverse can be used for corporate training. In particular how combining AR, VR and other Metaverse elements can be used to provide new types of learning experiences.
Empathic Computing: Developing for the Whole MetaverseMark Billinghurst
A keynote speech given by Mark Billinghurst at the Centre for Design and New Media at IIIT-Delhi. Given on June 16th 2022. This presentation is about how Empathic Computing can be used to develop for the entre range of the Metaverse.
keynote speech by Mark Billinghurst at the Workshop on Transitional Interfaces in Mixed and Cross-Reality, at the ACM ISS 2021 Conference. Given on November 14th 2021
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
3. How can we Interact in VR?
• How can VR devices create a natural user experience?
4. Universal 3D Interaction Tasks in VR
• Object Interaction
• Selection: Picking object(s) from a set
• Manipulation: Modifying object properties
• Navigation
• Travel: motor component of viewpoint motion
• Wayfinding: cognitive component; decision-making
• System control
• Issuing a command to change system state or mode
5. Selection and Manipulation
• Selection:
• specifying one or more objects from a set
• Manipulation:
• modifying object properties
• position, orientation, scale, shape, color, texture, behavior, etc.
7. Ray-casting technique
• “Laser pointer” attached
to virtual hand
• First object intersected by
ray may be selected
• User only needs to
control 2 DOFs
• Proven to perform well
for remote selection
• Variants:
• Cone casting
• Snap-to-object rays
9. World-in-miniature (WIM) technique
• “Dollhouse” world held in
user’s hand
• Miniature objects can be
manipulated directly
• Moving miniature objects
affects full-scale objects
• Can also be used for
navigation
Stoakley, R., Conway, M., & Pausch, R. (1995). Virtual Reality on a WIM: Interactive Worlds in
Miniature. Proceedings of CHI: Human Factors in Computing Systems, 265-272, and
Pausch, R., Burnette, T., Brockway, D., & Weiblen, M. (1995). Navigation and Locomotion in
Virtual Worlds via Flight into Hand-Held Miniatures. Proceedings of ACM SIGGRAPH, 399-400.
10. Navigation
• How we move from place to place within an environment
• The combination of travel with wayfinding
• Wayfinding: cognitive component of navigation
• Travel: motor component of navigation
• Travel without wayfinding: "exploring", "wandering”
11. Types of Travel
• Exploration
• No explicit goal for the movement
• Search
• Moving to specific target location
• Naïve – target position not known
• Primed – position of target known
• Maneuvering
• Short, precise movements changing viewpoint
12. Gaze Directed Steering
• Move in direction that you are looking
• Very intuitive, natural navigation
• Can be used on simple HMDs (e.g. Google Cardboard)
• But: Can’t look in different direction while moving
13. TelePortation
• Use controller to select end point
• Usable with 3DOF contoller
• Jump to a fixed point in VR
• Discrete motion can be confusing/cause sickness
14. Redirected Walking
• Address problem of limited
walking space
• Warp VR graphics view of
space
• Create illusion of walking
straight, while walking in circles
Razzaque, S., Kohn, Z., & Whitton, M. C. (2001, September). Redirected walking.
In Proceedings of EUROGRAPHICS (Vol. 9, pp. 105-106).
15. Wayfinding – Making Cognitive Maps
• Goal of Wayfinding is to build Mental Model (Cognitive Map)
• Types of spatial knowledge in a mental model
• landmark knowledge
• procedural knowledge (sequence of actions required to follow a path)
• map-like (topological) knowledge
• Creating a mental model
• systematic study of a map
• exploration of the real space
• exploration of a copy of the real space
• Problem: Sometimes perceptual judgments are incorrect
within a virtual environment
• e.g. users wearing a HMD often underestimate dimensions of space,
possibly caused by limited field of view
16. Designing VE to Support Wayfinding
• Provide Landmarks
• Any obvious, distinct and non-mobile
object can serve as a landmark
• A good landmark can be seen from
several locations (e.g. tall)
• Audio beacons can also serve as
landmarks
• Use Maps
• Copy real world maps
• Ego-centric vs. Exocentric map cues
• World in Miniature
• Map based navigation
17. System Control
• Issuing a command to change system state or mode
• Examples
• Launching application
• Changing system settings
• Opening a file
• Etc.
• Key points
• Make commands visible to user
• Support easy selection
18. 2D Menus in VR
• Many examples of 2D GUI and floating menus in VR
Nested Pie Menu
2D Menu in VR CAVE
19. How Can we Design Useful VR?
• Designing VR experiences that meet real needs
20. The Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Develop alternative prototypes/concepts and compare them
And iterate, iterate, iterate....
21. Methods for Identifying User Needs
Learn
from
people
Learn
from
analogous
settings
Learn
from
Experts
Immersive
yourself in
context
22. Is VR the Best Solution?
• Not every problem can be solved by VR..
• Problems Ideal for Virtual Reality, have:
• visual elements
• 3D spatial interaction
• physical manipulation
• procedural learning
• Problems Not ideal for Virtual Reality, have:
• heavy reading, text editing
• many non-visual elements
• need for connection with real world
• need for tactile, haptic, olfaction feedback
23. Typical VR Interface Metaphors
• Direct Manipulation
• Reach out and directly grab objects
• Ray Casting
• Select objects through ray from head/hand
• Vehicle Movement
• Move through VR environment through vehicle movement
24. Affordances in VR
• Design interface objects to show how they are used
• Use visual cues to show possible affordances
• Perceived affordances should match actual affordances
• Good cognitive model - map object behavior to expected
Familiar objects in Job Simulator Object shape shows how to pick up
25. UX Guidelines for VR
• The Four Cores of UX Design for VR
• Make interface Interactive and Reactive
• Design for Comfort and Ease
• Use usable Text and Image Scale
• Include position audio and 3D sound
https://www.dtelepathy.com/blog/philosophy/ux-guide-designing-virtual-reality-experiences
26. Cardboard Design Lab
• Mobile VR App providing examples of best practice VR
designs and user interaction (iOS, Play app stores)
27. What is Evaluation?
•Evaluation is concerned with
gathering data about the usability
of a design or product by a
specified group of users for a
particular activity within a specified
environment or work context
29. Quick and Dirty
• ‘quick & dirty’ evaluation: informal feedback from
users or consultants to confirm that their ideas are
in-line with users’ needs and are liked.
• Quick & dirty evaluations are done any time.
• Emphasis is on fast input to the design process
rather than carefully documented findings.
30. Usability Testing
• Recording typical users’ performance on typical
tasks in controlled settings.
• As the users perform tasks they are watched &
recorded on video & their inputs are logged.
• User data is used to calculate performance times,
errors & help determine system usability
• User satisfaction questionnaires & interviews are
used to elicit users’ opinions.
31. Field/Ethnographic Studies
• Field studies are done in natural settings
• The aim is to understand what users do naturally
and how technology impacts them.
• In product design field studies can be used to:
- identify opportunities for new technology
- determine design requirements
- decide how to introduce new technology
- evaluate technology in use.
32. Predictive Evaluation
• Experts apply their knowledge of typical
users, often guided by heuristics, to
predict usability problems.
• Can involve theoretically based models.
• A key feature of predictive evaluation is
that users need not be present
• Relatively quick and inexpensive
33. Pilot Studies
• A small trial run of the main study.
• Can identify majority of issues with interface design
• Pilot studies check:
- that the evaluation plan is viable
- you can conduct the procedure
- that interview scripts, questionnaires,
experiments, etc. work appropriately
• Iron out problems before doing the main study.
34. Controlled Experiments
• Designer of a controlled experiment should
carefully consider:
• proposed hypothesis
• selected subjects
• measured variables
• experimental methods
• data collection
• data analysis
35. Subjects
• The choice of subjects is critical to the validity of the
results of an experiment
• subjects group should represent expected user population
expected user population
• Consider subject factors such as:
• age group, education, skills, culture, technology background
• The sample size should be large enough (10+) to be
statistically representative of the user population
36. Hypothesis and Variables
• Hypothesis: prediction of the experiment outcome
• Experiments manipulate and measure variables
under controlled conditions
• There are two types of variables
• independent: variables that are manipulated to create
different experimental conditions
• e.g. number of items in menus, colour of the icons
• dependent: variables that are measured to find out the
effects of changing the independent variables
• e.g. speed of menu selection, speed of locating icons
37. Experimental Methods
Randomly
assigned
Statistical data analysis
Experimental
task
Condition
2
Condition
3
Condition
1
Subjects
data data data
Between-
groups
Randomly
assigned
Statistical data analysis
Subjects
data data data
Within-
groups
Experimental
tasks
Condition
2
Condition
3
Condition
1
Experimental
tasks
Condition
1
Condition
3
Condition
2
Experimental
tasks
Condition
1
Condition
2
Condition
3
38. Data Types
• Subjective (Qualitative)
• Subjective survey
• Likert Scale, condition rankings
• Observations
• Think Aloud
• Interview responses
• Objective (Quantitative)
• Performance measures
• Time, accuracy, errors
• Process measures
• Video/audio analysis
How easy was the task
1 2 3 4 5
Not very easy Very easy
41. Virtual Reality Applications
• Ideal applications for VR should:
• Be strongly visual, have 3D spatial elements
• Benefit from first person immersion
• Benefit from 3D manipulation/navigation
• Support Autonomy, Interaction and Presence (AIP Cube)
• Etc..
43. Many Possible Types of VR Applications
From https://www.slideshare.net/ampnewventures/virtual-reality-vr-continuum-amp-new-ventures
44.
45. Potential Disruption for Existing Domains
https://www.slideshare.net/BDMIFund/the-emerging-virtual-reality-landscape-a-primer
46. Example VR Applications
• Education
• Google Expeditions
• Medicine
• Virtual Characters
• Entertainment
• The Void, Zero Latency
• Art + Design
• Tilt Brush
• Collaboration
• Facebook Spaces
49. Google Expeditions
• Goal: Provide low cost educational VR experience
• Based on Google Cardboard VR platform
• Different roles:
• Guide— person leading an expedition on a tablet
• Explorer— person following an expedition on a phone.
• Usage
• Used by millions of students
• Over 1000 educational experiences developed
• Royal Collection Trust, American Museum of Natural History, etc.
50. Teacher Led VR Experiences
• Teacher/Guide uses tablet to control the experience
• Selects the virtual tour experience
• Guide sees tour script, can select immersive scenes to view
• Guide sees focus point and where individual students are looking
• Students connect as followers, look at what guides highlight
Guide Interface
51. System
• Hardware
• Google Cardboard mobile viewer
• Smart phones + tablet (class set)
• Wireless router
• Software
• Viewer and Guide applications (iOS/Android)
• 360 image/video VR experiences
Class set for 30 students
52. Example Experiences
• Over 1000 locations/experiences
• Great barrier reef, Great Wall of China, Grand Canyon, etc.
54. Feedback
• Teacher/student survey (100 people)
• 65% experienced a “Wow” moment during Google expedition
• Noted the variety of educator styles and approaches possible
• People enjoyed “The feeling of ‘being’ there”
From https://www.slideshare.net/zoesujon/google-expeditions-virtual-reality-and-the-classroom
55. Limitations
• But 53% of participants identified some problems:
• Difficult for some people who wore glasses
• Some complained of eye strain, headaches or nausea
• Some staff were reluctant/resistant to use the leader tablet
• Issues of disabilities and inclusion
56. Key Findings
• Low-cost VR/mobile VR can provide a valuable
educational experience
• Visit different locations, different times, etc.
• Teach interaction key
• Acting as guide, providing educational context
• VR requires more work
• Address simulator sickness, ergonomic issues, etc.
• Immersion/Presence creates learning
• Immersion creates memorable educational experience
57. Challenges/Solutions
• Making VR accessible
• Designing for phones, tablets, low cost viewers
• Synchronizing content with all viewers
• Teacher controlled viewing
• Teacher can guide experiences
• Engaging interaction on simple viewers
• Head pointing based interaction, button input
• Supporting Educational goals
• Providing compelling educational content
59. Virtual Patients
• Problem
• Many doctors have poor doctor/patient skills
• Have limited opportunity during training to learn skills
• Solution
• Virtual patients that doctors can communicate with naturally
• Artificial agents with speech understanding
60. Typical System Setup
• Trainee in front of projection screen
• Speech and gesture recognition
• Intelligent agent on screen
Johnsen, K., Raij, A., Stevens, A., Lind, D. S., & Lok, B. (2007, April). The validity of a virtual human experience for interpersonal
skills education. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 1049-1058). ACM.
62. Key Findings
• Virtual Humans can replace actors in training
• interaction skills used with a virtual human translate to
the interaction skills used with a real human
• Students feel a strong sense of co-presence
• Having character respond to speech and gesture
increases immersion
• VR is capable of creating realistic characters
• Life size, intelligent backend, speech recognition
• Skills learnt transfer to real world
63. Challenges/Solutions
• Training in medical environment
• Design for training in medical exam room
• Use projected VR not HMDs
• Natural interaction
• Support speech and gesture interaction
• Tactile/haptic feedback
• Use prosthetics to add support for palpation and other
tactile interaction between doctor and virtual patient
• Supporting Educational goals
• Give virtual character domain knowledge
65. Large Scale VR Gaming
• Provide multi-player VR gaming in warehouse space
• Examples
• The Void - https://www.thevoid.com/
• Zero Latency - https://zerolatencyvr.com/
66. Typical System
• Wide Area Tracking
• Computer vision, lights/reflective balls
• > 120 cameras for 300 m2
space
• Backpack VR system
• Haptic feedback, wireless HMD
• Real Props
• Tracked objects, walls
Tracking cameras
Backpack system
68. Key Findings
• Wide area tracking possible
• vision based systems can create large scale wide areas
tracking, fast enough for game play
• Shared gameplay improves experience
• Focus on collaborative experiences, using avatar
representations and roll division
• Haptic feedback significantly increases presence
• Use of physical props (objects, walls)
• Content is king
• Systems need compelling content/game place
69. Challenges/Solutions
• Wide area tracking
• Computer vision tracking of people
• Over 100 cameras + multiple servers
• Freedom of movement
• Custom wireless VR backpacks
• Ruggedized HMDs, weapon props
• Natural interaction
• Redirected walking, tangible props
• Compelling content
• Multi-sensory feedback, custom game platform
71. Tilt Brush
• Intuitive 3D immersive drawing/sculpting program
• Developed by Patrick Hackett and Drew Skillman 2014
• Acquired by Google in 2015/Open sourced 2021
• https://www.tiltbrush.com/
72. Functionality
• Goal: Extremely natural 3D painting/sculpting
• User Interface
• Two handed interface designed for two controllers (Vive, Rift)
• Brush in dominant hand, tool palette in non-dominant
• Typical drawing functionality – color, brush width, undo/redo, etc..
• Content sharing
• Created content can be exported/shared in 2D/3D formats
76. Key Findings
• Use familiar tools
• Tilt brush interface has familiar sculpting/painting tools –
e.g. brush size, colour pallet, etc
• Use intuitive interface
• Two handed tools with natural metaphor – one hand for
pallet/menu, one hand for painting/sculpting
• Provide Magical experience
• Provide experience not possible in real world, e.g.
changing body scale, painting in 3D, etc.
• Create a community
• Provide ways for people to share content
77. Challenges/Solutions
• Intuitive Interface
• Very natural metaphor – painting in space
• Two handed interface – map to VR controllers
• Familiar menu objects from paint programs
• Need for limited training
• Provide in app training, tool tips
• Content sharing
• Enable content to be exported in variety of formats
• Video, animated GIFs, 2D images, 3D files
• Engaging Experience
• Provides novel immersive artistic experience
81. A wide variety of communication cues used.
Speech
Paralinguistic
Para-verbals
Prosodics
Intonation
Audio
Gaze
Gesture
Face Expression
Body Position
Visual
Object Manipulation
Writing/Drawing
Spatial Relationship
Object Presence
Environmental
Face to Face Communication
82. Face to Face Communication
Audio Cues
Visual Cues
Environmental Cues
88. Why is Video Conferencing so Tiring?
• Physical factors
• Poor posture
• Staring at fixed screen
• Longer hours/work anytime
• Cognitive factors
• Loss of non-verbal cues, eye gaze
• Need to focus more intently
• Multi-tasking/split attention
• Social factors
• Aware of being watched
• Seeing yourself
• Constant staring
“It's almost like you're
emoting more because
you're just a little box on a
screen”. “I’m just so tired.”
“You have to fill in the
gaps. And that takes
cognitive energy. You get
tired more quickly.”
“For somebody who’s
really dependent on those
non-verbal cues, it can be
a big drain not to have
them.”
92. Limitations with Current Technology
•Lack of spatial cues
• Person blends with background
•Poor communication cues
• Limited gaze, gesture, non-verbal communication
•Introduction of artificial seams
• Separation of task/communication space
93. Facebook Spaces
• Collaborative VR environment
• VR meeting and interaction space (up to 4 people)
• Focus on communication
• Speech and gesture based
• https://www.facebook.com/spaces
94. System Interaction
• Designed for Oculus Rift/HTC Vive
• Upper body tracking, touch controllers
• Simple interaction
• Loading scenes, direct object manipulation
• Content creation
• Selfie pictures, simple sketching
96. Facebook Workrooms
• Designed to support meetings
• Meeting seating
• Shared blackboard
• Limited movement
• Support for real devices
• Keyboard/mouse input
• Calibrated computer screen
• Private space/public space
• Rich communication cues
• Lip sync
• Natural gestures
103. Other Examples
• Many other examples of collaborative VR
• Rec Room, High Fidelity, AltspaceVR
• Sansar, VR chat, etc..
104. Mozilla Hubs
• Web based social VR
• Customizable avatars, spatial audio, 3D environments
• Multi-device support
• HMDs, Desktop, Mobile
• Open source
• https://hubs.mozilla.com
105.
106. Mozilla Hubs Spoke Creator
• Drag and drop scene editing
• Upload assets
• 3D objects, textures, animaton
• Customize content – Sketchup, Google Poly, Sketchfab, etc
109. Key Findings
• Minimal social cues okay
• Even simple avatars can provide rich social experience
• Create shared social context
• Important to place users in same shared Virtual Reality
environment/shared social context
• Audio is key
• Provide low latency audio, spatial audio cues
• Create a reason for communicating
• Why should people want to connect? Create shared
activity/reason for people to conference
110. Challenges/Solutions
• Create shared sense of Presence
• Use common background, shared objects
• Natural communication
• Support non-verbal behaviour, speech/gesture input
• Intuitive interaction
• Map real body motion onto Avatars
• Limited ability to navigate/move through environment
• Engaging Experience
• Shared content creation, experience capture
114. Best VR Apps of 2019 (Digital Trends)
• ALLUMETTE – VR Stop motion film
• Google Earth – Travel/geography
• Kingspray Graffiti – Art/content creation
• The FOO Show - VR Talk show
• Virtual Desktop – Use desktop in VR
• www.digitaltrends.com/virtual-reality/best-virtual-reality-apps/
123. The ultimate display would, of course, be a room within
which the computer can control the existence of matter. A
chair displayed in such a room would be good enough to sit
in. Handcuffs displayed in such a room would be confining,
and a bullet displayed in such a room would be fatal..
Sutherland, Ivan. "The ultimate display." (1965).
139. Future Visions of VR: Ready Player One
• https://www.youtube.com/watch?v=LiK2fhOY0nE
140. Today vs. Tomorrow
VR in 2021 VR in 2045
Graphics High quality Photo-realistic
Display 110-150 degrees Total immersion
Interaction Handheld controller/some gesture Full gesture/body/gaze
Navigation Limited movement Natural
Multiuser Few users Millions of users
143. “.. the technologies that will significantly
affect our lives over the next 10 years
have been around for a decade. The
future is with us ... The trick is learning
how to spot it”
October 2004
Bill Buxton
145. Conclusions
• AR/VR/MR is becoming commonly available
• Significant advances over 50+ years
• In order to achieve Sutherland’s vision, need research in
• Display, Tracking, Input
• New MR technologies will enable this to happen
• Display devices, Interaction, Tracking technologies
• There are still significant areas for research
• Social Acceptance, Perception, Collaboration, Etc.