An Approach for Model Based Testing of Augmented Reality Applications.pdf

An Approach for Model Based Testing of
Augmented Reality Applications
Porfirio Tramontana, Marco De Luca
Anna Rita Fasolino
University of Naples “Federico II”
3rd International Workshop on Quality and Measurement of
Software Model-Driven Development - QUAMES 2022
QUAMES @ RCIS 2022, Barcelona, May 17, 2022

Motivations
◼ Augmented Reality applications mixes :
◼ A layer provided by a camera
◼ With callbacks related to image recognition
◼ Other layers consisting of interactive widgets
➢ Substantially, they are interactive applications
? How their behaviour can be modelled?
? May Model-based testing be suitable on
them?

Extended Reality Taxonomy
◼ Virtual reality (immersive or non-immersive VR)
◼ where the application simulates a completely different
environment around the user;
◼ Augmented reality (AR)
◼ where the application combines its own digital
environment with the user’s real-world environment
and allows them to interact with each other.

Unity 3D / Vuforia Ecosystem
◼ Unity 3D is one of the most popular
alternative for the development of AR and
VR applications
◼ They can be deployed on mobile devices as
native applications
◼ Vuforia provides off-the-shelf services for
continuous image recognition, based on
ML algorithms

Unity 3D application model
◼ Scene: GUI with a designed layout
(and transparency)
◼ GameObjects: interactive objects
◼ Components: associated to scenes or
game objects, may implement
listeners
◼ Event Listeners: callbacks related to
components
◼ Includes Vuforia callbacks activated by
the recognizing of graphic markers

Research questions
? How the behaviour of an Augmented
Reality application can be modelled?
? May the model be used to realize Model
Based Testing approaches?
QUAMES @ RCIS 2022 Workshops, Barcelona, May 17, 2022

Model Based Testing of AR applications
◼ Modeling → Finite State Machines
◼ Test Selection Criteria → All States
Coverage / All Transitions Coverage / All
Prime Paths Coverage
◼ Test Case Implementation and Execution
→ AirTest

FSM Model of AR Behaviour

Test Selection Criteria
◼ All States Coverage
◼ each state of the FSM model is reached by at
least a test case
◼ All Transitions Coverage
◼ each transition of the FSM model is reached
by at least a test case
◼ All Prime Paths Coverage
◼ each prime path on the FSM is covered by at
least a test case.

AR Test Framework
◼ AirTest
◼ Supports the writing of automatically
executable test scripts
◼ The poco object acts as a starting point to query
the object model of the application during its
execution
◼ Can be used in isolation, without need of a
client/server infrastructure (as AltUnity)

Test Case Structure
◼ A global object poco
◼ Setup function starting the app and instantiating
poco
◼ A verify function for each state of the model to
assert the reaching of the state by evaluating
widgets reachable via the poco object
◼ A main function with a sequence of state verify
and user event triggering

Test Case Structure

Test Case Structure
poco
setup
verify
main

Case Studies
◼ Two small Case
Studies:
◼ A1: PointAR
◼ A2: SafariAnimals
◼ Three test suites:
◼ TS1: All States Cov.
◼ TS2: All Transitions Cov.
◼ TS3: All Prime Paths Cov.

Results
◼ Feasibility of the approach
◼ Transition & Prime Path coverage
produced high code coverage, too
◼ Uncovered branches:
◼ An unfeasible branch
◼ A branch that needed a larger path

Perspective, Limitations, Future Work
◼ Preconditions
◼ AirTest currently does not support setting of
image markers
◼ To have it an interaction with an external image
injector should be considered
◼ Model formalization
◼ Need to generalize the application model
◼ to reverse engineer it from code
◼ To generate test cases from the model

Perspective, Limitations, Future Work
◼ Need to evaluate on larger applications
and with real defects
◼ There are very few examples of open source
AR projects with test cases and documented
faults
◼ Mutants could be considered

Thank you for your attention!

An Approach for Model Based Testing of Augmented Reality Applications.pdf

Recommended

Recommended

More Related Content

Similar to An Approach for Model Based Testing of Augmented Reality Applications.pdf

Similar to An Approach for Model Based Testing of Augmented Reality Applications.pdf (20)

More from Porfirio Tramontana

More from Porfirio Tramontana (20)

Recently uploaded

Recently uploaded (20)

An Approach for Model Based Testing of Augmented Reality Applications.pdf