The usability testing of mobile applications involving persons with Down syndrome is an issue that has not be comprehensively investigated and there is no single proposal that takes on board all the issues that could be taken into account[1]. This study aims to propose a practical guide ¨USATESTDOWN¨ to measure and evaluate the usability of mobile applications focusing on Down syndrome users and their primary limitations. The study starts with an analysis of existing methodologies and tools to evaluate usability and
integrates concepts related to inspection and inquiry methods into a proposal. The proposal includes the opinions of experts and representative users; their limitations, the applicability during the development process and the accessibility. This guide is based on the literature review and the author’s experience in several workshops where persons with Down syndrome used mobile devices.
““USATESTDOWN” A PROPOSAL OF A USABILITY TESTING GUIDE FOR MOBILE APPLICATION...csandit
The usability testing of mobile applications involving persons with Down syndrome is an issue
that has not be comprehensively investigated and there is no single proposal that takes on board
all the issues that could be taken into account[1]. This study aims to propose a practical guide
¨USATESTDOWN¨ to measure and evaluate the usability of mobile applications focusing on
Down syndrome users and their primary limitations. The study starts with an analysis of
existing methodologies and tools to evaluate usability and integrates concepts related to
inspection and inquiry methods into a proposal. The proposal includes the opinions of experts
and representative users; their limitations, the applicability during the development process and
the accessibility. This guide is based on the literature review and the author
This document discusses the development of a mobile application in Indonesia called Jalan Kita that allows users to report damaged road conditions. The existing application had usability issues like difficult registration/login and slow GPS. To address this, the authors redesigned the user interface and experience using a user-centered design approach. They analyzed user needs, designed solutions, and tested the new design. Testing showed a System Usability Scale score of 82 (excellent) and a positive user experience questionnaire response, indicating improved usability and user experience.
Enabling People With Disabilities To Access Health And Safety Assistance Via ...Global Risk Forum GRFDavos
This document discusses research into enabling people with disabilities, specifically the visually impaired, to access health and safety information via mobile technology. The research focuses on designing accessible mobile applications through user-centered design and field testing with visually impaired users. The research aims to address the challenge that most mainstream mobile devices have visual interfaces that are not accessible. By iteratively involving visually impaired users and improving features like screen readers and haptic feedback, the studies demonstrated an improved user experience and ability to complete tasks through mobile applications. The research concludes that refining common mobile device features can help compensate for sensory impairments and ensure access to important health information for the visually impaired population.
Nowadays, computers and internet are playing the major role in the development of business and different aspects of human lives; hence, the quality of user-computer interface became an important issue. User interface (UI) can become an Achilles heel in a well-functioning system; due to the fact that most users judge the quality of a product by its usability. The UI layout design improves the usability of a product and accordingly may determine its success; so, due to this and more, the need of an objective way of evaluation of UI has arisen. This paper discusses various UI usability evaluation techniques and shows the recent developments in this field.
This literature review evaluates different usability and user experience evaluation methods. It discusses approaches like agile UX, design thinking, and lean UX. While the methods have similarities in aiming to improve productivity and collaboration, they differ in their approaches. For example, agile UX debates the merits of big upfront design versus minimal design. The review also identifies gaps, such as the need for more research on evaluating methods in real-world contexts versus labs.
Human Computer Interaction Chapter 3 HCI in the Software Process and Design ...VijiPriya Jeyamani
The document discusses various aspects of the software development life cycle and human-computer interaction design rules. It describes the typical phases of software development like requirements specification, architectural design, detailed design, coding, testing, and maintenance. It also discusses design principles, standards, guidelines, heuristics and patterns that can improve usability. Iterative design and prototyping approaches are presented as methods to refine requirements and designs. The importance of documenting design rationale is highlighted.
UI/UX integrated holistic monitoring of PAUD using the TCSD methodjournalBEEI
User interface (UI)/user experience (UX) is one part of the stages in the development of the system to produce interactive and attractive web-based application layouts so that it is easy to understand and use by users. In this research, a case study was conducted on early childhood in PAUD Kuntum Mekar. The design of the UI/UX model for holistic integrative PAUD monitoring becomes one of the solutions to help parents and teachers. The method used to design UI/UX is the task centered system design (TCSD) approach starting from the stages; 1) identification scope of use, 2) user centered requirement analysis, 3) design and scenario, and 4) walkthrough evaluate, the method used for system testing is user satisfaction, and heuristic usability. The purpose of this study is the UI/UX design with TCSD can provide valid data needs of each actor based on the assignment and design of the story board of the developed system. The results of this research are UI/UX model design for integrative holistic PAUD monitoring application.
This document discusses six healthcare trends and why user experience matters for addressing them. It provides definitions of usability and user experience, arguing that user experience is broader and requires understanding user needs from the start. The six trends are: 1) increased adoption of electronic medical records, 2) increased patient engagement, 3) mobile health becoming mainstream, 4) moving towards accountable care, 5) rise of retail health clinics, and 6) increased care at home solutions. For each trend, the document discusses challenges and how user-centered design can help address them.
““USATESTDOWN” A PROPOSAL OF A USABILITY TESTING GUIDE FOR MOBILE APPLICATION...csandit
The usability testing of mobile applications involving persons with Down syndrome is an issue
that has not be comprehensively investigated and there is no single proposal that takes on board
all the issues that could be taken into account[1]. This study aims to propose a practical guide
¨USATESTDOWN¨ to measure and evaluate the usability of mobile applications focusing on
Down syndrome users and their primary limitations. The study starts with an analysis of
existing methodologies and tools to evaluate usability and integrates concepts related to
inspection and inquiry methods into a proposal. The proposal includes the opinions of experts
and representative users; their limitations, the applicability during the development process and
the accessibility. This guide is based on the literature review and the author
This document discusses the development of a mobile application in Indonesia called Jalan Kita that allows users to report damaged road conditions. The existing application had usability issues like difficult registration/login and slow GPS. To address this, the authors redesigned the user interface and experience using a user-centered design approach. They analyzed user needs, designed solutions, and tested the new design. Testing showed a System Usability Scale score of 82 (excellent) and a positive user experience questionnaire response, indicating improved usability and user experience.
Enabling People With Disabilities To Access Health And Safety Assistance Via ...Global Risk Forum GRFDavos
This document discusses research into enabling people with disabilities, specifically the visually impaired, to access health and safety information via mobile technology. The research focuses on designing accessible mobile applications through user-centered design and field testing with visually impaired users. The research aims to address the challenge that most mainstream mobile devices have visual interfaces that are not accessible. By iteratively involving visually impaired users and improving features like screen readers and haptic feedback, the studies demonstrated an improved user experience and ability to complete tasks through mobile applications. The research concludes that refining common mobile device features can help compensate for sensory impairments and ensure access to important health information for the visually impaired population.
Nowadays, computers and internet are playing the major role in the development of business and different aspects of human lives; hence, the quality of user-computer interface became an important issue. User interface (UI) can become an Achilles heel in a well-functioning system; due to the fact that most users judge the quality of a product by its usability. The UI layout design improves the usability of a product and accordingly may determine its success; so, due to this and more, the need of an objective way of evaluation of UI has arisen. This paper discusses various UI usability evaluation techniques and shows the recent developments in this field.
This literature review evaluates different usability and user experience evaluation methods. It discusses approaches like agile UX, design thinking, and lean UX. While the methods have similarities in aiming to improve productivity and collaboration, they differ in their approaches. For example, agile UX debates the merits of big upfront design versus minimal design. The review also identifies gaps, such as the need for more research on evaluating methods in real-world contexts versus labs.
Human Computer Interaction Chapter 3 HCI in the Software Process and Design ...VijiPriya Jeyamani
The document discusses various aspects of the software development life cycle and human-computer interaction design rules. It describes the typical phases of software development like requirements specification, architectural design, detailed design, coding, testing, and maintenance. It also discusses design principles, standards, guidelines, heuristics and patterns that can improve usability. Iterative design and prototyping approaches are presented as methods to refine requirements and designs. The importance of documenting design rationale is highlighted.
UI/UX integrated holistic monitoring of PAUD using the TCSD methodjournalBEEI
User interface (UI)/user experience (UX) is one part of the stages in the development of the system to produce interactive and attractive web-based application layouts so that it is easy to understand and use by users. In this research, a case study was conducted on early childhood in PAUD Kuntum Mekar. The design of the UI/UX model for holistic integrative PAUD monitoring becomes one of the solutions to help parents and teachers. The method used to design UI/UX is the task centered system design (TCSD) approach starting from the stages; 1) identification scope of use, 2) user centered requirement analysis, 3) design and scenario, and 4) walkthrough evaluate, the method used for system testing is user satisfaction, and heuristic usability. The purpose of this study is the UI/UX design with TCSD can provide valid data needs of each actor based on the assignment and design of the story board of the developed system. The results of this research are UI/UX model design for integrative holistic PAUD monitoring application.
This document discusses six healthcare trends and why user experience matters for addressing them. It provides definitions of usability and user experience, arguing that user experience is broader and requires understanding user needs from the start. The six trends are: 1) increased adoption of electronic medical records, 2) increased patient engagement, 3) mobile health becoming mainstream, 4) moving towards accountable care, 5) rise of retail health clinics, and 6) increased care at home solutions. For each trend, the document discusses challenges and how user-centered design can help address them.
This document is a paper submitted by Stephen Norman for their Design Thinking module. It summarizes the process of redesigning the Salud dental software through paper prototyping. Key points:
- User research identified inefficiencies in Salud's navigation and window layering. Prototypes aimed to simplify this with a single-view interface.
- Personas like efficient dentist Dr. Jennifer Coady and hesitant consultant Dr. John Murray informed designs to increase productivity and intuitiveness.
- Scenarios placed users in contexts to evaluate prototypes. A grid system allowed precise tooth diagnoses.
- Early sketches explored flat and skeuomorphic designs. Competitor research led to a blended approach
AN APPROACH TO IMPROVEMENT THE USABILITY IN SOFTWARE PRODUCTSijseajournal
One of the significantaspects of software quality is usability. It is one of the characteristics that judge by
the success or failure of software applications. The most important risk facing the software applications is
usability which may lead to the existence of a gap between users and systems. This may lead to system
failure because of Poor design. This is due to the design is not based on the desires and requirements of the
customer. To overcome these problems, this paper proposed an approach to improve usability of software
applications to meet the needs of the customer and interacts with the user easily with an efficient and
effective manner.The proposed approach is based prototyping technique due to itssimplicity and it does not
require additional costs to elicit precise and complete requirement and design.
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...ijseajournal
This document summarizes a research study that examined how users' perceptions of a learning management system (LMS) design can differ based on socio-demographic factors like gender, age, experience, and role.
The study developed a questionnaire to assess users' satisfaction with various aspects of an LMS, including navigation experience and interface design. It also measured perceptions of seven interface design factors known to potentially cause frustration, like confusing features or ambiguous terminology.
The study aimed to see if perceptions of the design factors and satisfaction measures correlated. It also tested if perceptions differed based on socio-demographic background, and if a "one-size-fits-all" design approach led to varying satisfaction levels among different user groups.
The document discusses various international standards for usability and human-centered design, including ISO 9241. It provides an overview of parts of ISO 9241 that relate to visual display requirements, usability guidance, dialogue principles, information presentation, and human-centered design processes. The document also discusses how to conduct a heuristic evaluation to identify usability issues. Examples of usability heuristics that could be used include visibility of system status, user control and freedom, error prevention, and flexibility of use.
This document discusses different types of prototypes used at various stages of the design process. It defines a prototype as an early embodiment of a design concept. Low-fidelity prototypes include sketches, wireframes, paper prototypes and storyboards, which are fast and inexpensive ways to get early feedback. Medium and high-fidelity prototypes include click-through prototypes and mockups, which more closely resemble the final product. The document emphasizes that prototyping and testing solutions early allows for continuous iteration to refine designs based on user feedback.
This document summarizes Farrukh Sahar's work portfolio, which includes experience conducting various user experience research studies and publishing the results. Some of the studies included comparing electronic diary and UX curve evaluation methods, identifying user experience factors of a sports product, and investigating mobile communication technologies for the elderly. Farrukh has expertise in interviews, surveys, usability testing, and longitudinal evaluation methods. They have published research papers in conferences and journals and participated in graduate courses related to user experience research methods.
The document summarizes the process taken to redesign the Safe Work Australia website. It involved:
1) Analyzing user data and feedback to understand issues with the existing site like poor search and navigation.
2) Benchmarking other regulatory sites and identifying areas for improvement.
3) Creating user personas and testing prototypes with users to refine the information architecture and design.
4) Developing high-fidelity prototypes in HTML/CSS that dramatically improved task success rates in user testing.
5) Finalizing the redesign following the Digital Transformation Office process to create an optimal user experience for the new site.
Using Expert Evaluation to Assess the Usability of an Educational Mobile Game...Jorge Luis Pérez Medina
The labor market inclusion of people with intellectual dis- abilities is one of the main concerns of current societies. Non-profit associations make every-day efforts to improve the living conditions of these citizens. This contribu-tion presents a heuristic evaluation of an educational mobile game helping social workers and health professionals in their training in order to incorpo-rate into the labor market citizens with intellectual disabilities. The applica-tion provides technological support for cognitive skills training and is aimed at people with mild to moderate intellectual disability and who do not present physical difficulties that prevent the normal use of a mobile device. We use a development process that combines the iPlus methodology together with a collaborative user-centered approach. Suggested recommendations based on the results can improve the usability of the game developed.
This document compares fingerprint authentication to behavioral biometric authentication using 2D and 3D gestures on smartphones. The authors developed Android apps to test each method and collected data from 6 participants over 5 days. Preliminary results found that fingerprint authentication had the highest accuracy overall, while accuracy of gesture authentication varied significantly between users and gesture types. More data is needed to better understand the potential for gesture biometrics.
This document summarizes a student's dissertation on developing a Smartboard application to collect and gather data from children. The dissertation introduces the research background and problems, establishes goals and objectives, reviews relevant literature, and describes the development and evaluation of a Smartboard application prototype. Testing with children provided results and findings, allowing the student to suggest the Smartboard can be an effective method for collecting data from children in an enjoyable way.
Situational analysis of the subjective well-being of university software deve...IJAEMSJORNAL
Integral well-being is vital for the optimal functioning of people. The requirements for a software developer in the performance of their professional activity are varied and complex. These requirements range from working in multidisciplinary and multilingual teams, going through the challenge of technological advances of the discipline to commit to quality and innovation. To face these demands, it is essential that the developers have an optimal functioning, where the experience emotional and satisfaction with life play an important role. The objective of this article is to analyze the subjective well-being of university software developers in Puebla. The research is a quantitative cross-correlation study to identify statistically significant relationships between the different welfare variables. The study involved 47 university software developers from the city of Puebla. We use Pearson's multivariate correlation to validate the instruments and find relationships between variables, and Chi-squared statistics to calculate the dependency between them. The results reveal that the university software developers experience with higher incidence and intensity, the positive affections over the negatives. The affective balance (Net Affect), calculated as the difference of the weighted averages by duration between positive affective states and negative, was positive (mean = 1.31). "Concentrated" is the positive affective state with the highest incidence and with the highest reported intensity. "Tired" is the most experienced negative affect and highest in intensity. Developers spend 40% of their time experiencing negative affective states (U-index) and are moderately satisfied with their lives in general.
HELPING PEOPLE WITH DOWN SYNDROME THROUGH AN USABILITY TESTING GUIDE PROPOSAL...ijcseit
The usability testing of mobile applications involving persons with Down syndrome is an issue that has not
be comprehensively investigated and there is no single proposal that takes on board all the issues that
could be taken into account[1]. This study aims to propose a practical guide ¨USATESTDOWN¨ to measure
and evaluate the usability of mobile applications focusing on Down syndrome users and their primary
limitations. The study starts with an analysis of existing methodologies and tools to evaluate usability and
integrates concepts related to inspection and inquiry methods into a proposal. The proposal includes the
opinions of experts and representative users; their limitations, the applicability during the development
process and the accessibility. This guide is based on the literature review and the author’s experience in
several workshops where persons with Down syndrome used mobile devices.
1 Evaluating Mobile Applications A Spreadsheet Case .docxfelicidaddinwoodie
1
Evaluating Mobile Applications: A Spreadsheet Case
Study
Derek Flood, Rachel Harrison, Claudia Iacob*, David Duce
1Oxford Brookes University,
[derek.flood, rachel.harrison, iacob, daduce]@brookes.ac.uk
ABSTRACT
The power of mobile devices has increased dramatically in the last few years. These devices are becoming more
sophisticated and allow users to accomplish a wide variety of tasks while on the move. The ease with which
mobile apps can be created and distributed has resulted in a number of usability issues becoming more
prevalent. This paper describes the range of usability issues encountered at all stages of the mobile app life
cycle, from when users begin to search for an app to when they finally remove the app from their device. Using
these results we developed a number of guidelines for both app developers and app platform developers that
will improve the overall usability of mobile apps.
Keywords: Mobile technology, portable computing, application process model, mobile usability.
1 INTRODUCTION
Advances in technology have allowed a range of sophisticated devices to emerge which enable users
to perform a variety of tasks in a mobile context. These tasks include both tasks which were
previously only available on traditional desktop applications and tasks that are only enabled by the use
of mobile devices. To facilitate these tasks a wide range of mobile applications, referred to here as
apps, are available from easy to install locations, such as the App store provided by Apple or the
Android Marketplace provided by Google. In order to improve the portability of both of these types of
apps, a number of compromises are necessary. These compromises, such as smaller screen size, more
limited processing power and the mobile context in which the device is used, have frequently had a
negative effect on the usability of these apps. The compromises can most readily be seen during the
use of mobile apps. There has been a large amount of research into the usability of specific mobile
apps (Ahmadi, 2008; Geven, 2006; Schmield, 2009; Shrestha, 2007). However, little research has
been conducted on the selection, installation and removal of mobile apps, all of which can be
problematic. This paper presents a study in which we examined aspects of user interaction with
mobile apps during various steps in the usage lifecycle of mobile applications: application
identification, installation, usage, and removal. To illustrate the range of interactions that a user may
have with a mobile app we also present a mobile app process model which shows the typical life cycle
of a mobile app.
This paper is structured as follows. Section 2 describes related work. Section 3 addresses user
interaction with mobile devices. Section 4 of the paper outlines the case study conducted to
investigate the usability of mobile applications at various steps in their lifecycle. Based on this
investigation, a set of guidelines ...
A Critical Evaluation of Popular UX Frameworks Relevant to E-Health Appsrinzindorjej
This research paper aims to evaluate the usability, accessibility, and effectiveness of the current User Experience (UX) frameworks relevant to mobile health apps, with a specific focus on the FitBit app. The selected UX frameworks for evaluation include Nielsen Norman Group's 10 Usability Heuristics, Don Norman's Three Levels of Design, and Human-Centered Design. A mixed-method approach, comprising both qualitative and quantitative analyses, was employed to evaluate these frameworks. The FitBit app was assessed based on the selected frameworks, and the obtained results were compared with existing literature and industry standards. The main subject of this study is the critical evaluation of popular UX frameworks in the context of e-health apps, with a specific emphasis on the FitBit app. The evaluation factors considered include usability, accessibility, and effectiveness. By utilizing the selected UX frameworks, the paper seeks to identify the strengths and limitations of each framework in evaluating e- health apps. The achieved results reveal that Nielsen Norman Group's 10 Usability Heuristics are valuable in identifying usability issues within the FitBit app. Don Norman's Three Levels of Design effectively evaluate the overall user experience, providing insights into the app's design quality. Human- Centered Design, on the other hand, offers a comprehensive and holistic approach to designing for the user, encompassing various aspects of the FitBit app. Through this research, a comprehensive understanding of the strengths and limitations of the evaluated UX frameworks in relation to e-health apps, specifically the FitBit app, is attained. The findings contribute to the existing literature on UX evaluation and provide insights for designers and developers to enhance the user experience of mobile health applications.
The International Journal of Computational Science, Information Technology an...rinzindorjej
The International Journal of Computational Science, Information Technology and Control Engineering (IJCSITCE) is an open access peer-reviewed journal that publishes quality articles which make innovative contributions in all areas of Computational Science, Mathematical Modeling, Information Technology, Networks, Computer Science, Control and Automation Engineering. IJCSITCE is an abstracted and indexed journal that focuses on all technical and practical aspects of Scientific Computing, Modeling and Simulation, Information Technology, Computer Science, Networks and Communication Engineering, Control Theory and Automation. The goal of this journal is to bring together researchers and practitioners from academia and industry to focus on advanced techniques in computational science, information technology, computer science, chaos, control theory and automation, and establishing new collaborations in these areas.
The International Journal of Computational Science, Information Technology an...rinzindorjej
The International Journal of Computational Science, Information Technology and Control Engineering (IJCSITCE) is an open access peer-reviewed journal that publishes quality articles which make innovative contributions in all areas of Computational Science, Mathematical Modeling, Information Technology, Networks, Computer Science, Control and Automation Engineering. IJCSITCE is an abstracted and indexed journal that focuses on all technical and practical aspects of Scientific Computing, Modeling and Simulation, Information Technology, Computer Science, Networks and Communication Engineering, Control Theory and Automation. The goal of this journal is to bring together researchers and practitioners from academia and industry to focus on advanced techniques in computational science, information technology, computer science, chaos, control theory and automation, and establishing new collaborations in these areas.
ER Publication,
IJETR, IJMCTR,
Journals,
International Journals,
High Impact Journals,
Monthly Journal,
Good quality Journals,
Research,
Research Papers,
Research Article,
Free Journals, Open access Journals,
erpublication.org,
Engineering Journal,
Science Journals,
Engineering Research Publication
Best International Journals, High Impact Journals,
International Journal of Engineering & Technical Research
ISSN : 2321-0869 (O) 2454-4698 (P)
www.erpublication.org
A Conceptual Design And Evaluation Framework For Mobile Persuasive Health Tec...Kate Campbell
This document presents a conceptual framework for designing and evaluating the usability of mobile persuasive health technologies. It begins with an introduction on the increasing popularity and use of mobile health apps but also notes that evaluating these apps, particularly with regards to usability, remains a challenge.
The document then reviews existing models for evaluating usability, including the Persuasive Systems Design (PSD) model, various usability models like ISO and Nielsen, and integrated models like PACMAD. It notes that while PSD is useful for design, it is limited for evaluation as its principles are subjective and cannot be easily quantified.
The paper then proposes extending the PSD model with an integrated usability model and using fuzzy analytic hierarchy process to
This document describes a virtual supermarket simulator application created by Emil Rosenlund Høeg and Luca Mangano. The application was developed for Aalborg University's Integrated Food Studies program as a tool to study consumer behavior and decision making in a virtual environment. A usability test was conducted with 17 participants to evaluate the application based on learnability, effectiveness, efficiency, errors, and satisfaction. The results showed that participants felt limited by the application's current functionality but provided suggestions for improvements to enhance the experience. The project demonstrated potential for a virtual simulation tool but requires further refinement of the user interface, textures, and interaction techniques to achieve its goals.
Human computer interaction (HCI) is concerned with the practice of usability, which is a measure that
evaluates the simplicity of using a system, software, or interface design for performing particular tasks.
Evaluation is a process by which designers gather information about a systems usability to improve its user
interfaces features. This research presents a study of a usability evaluation of EduGate, an online
academic portal of King Saud University. In this research the heuristic evaluation method was chosen to
evaluate the usability of the EduGate. Our results show that, the EduGate suffers from certain usability
problem and some recommendations were proposed to enhance the usability of the EduGate. A
questionnaire was then used to collect the feedback of real users (i.e. students) on the value of these
recommendations. The participants supported 80% of the proposed recommendations to improve the
usability of the EduGate.
This document is a paper submitted by Stephen Norman for their Design Thinking module. It summarizes the process of redesigning the Salud dental software through paper prototyping. Key points:
- User research identified inefficiencies in Salud's navigation and window layering. Prototypes aimed to simplify this with a single-view interface.
- Personas like efficient dentist Dr. Jennifer Coady and hesitant consultant Dr. John Murray informed designs to increase productivity and intuitiveness.
- Scenarios placed users in contexts to evaluate prototypes. A grid system allowed precise tooth diagnoses.
- Early sketches explored flat and skeuomorphic designs. Competitor research led to a blended approach
AN APPROACH TO IMPROVEMENT THE USABILITY IN SOFTWARE PRODUCTSijseajournal
One of the significantaspects of software quality is usability. It is one of the characteristics that judge by
the success or failure of software applications. The most important risk facing the software applications is
usability which may lead to the existence of a gap between users and systems. This may lead to system
failure because of Poor design. This is due to the design is not based on the desires and requirements of the
customer. To overcome these problems, this paper proposed an approach to improve usability of software
applications to meet the needs of the customer and interacts with the user easily with an efficient and
effective manner.The proposed approach is based prototyping technique due to itssimplicity and it does not
require additional costs to elicit precise and complete requirement and design.
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...ijseajournal
This document summarizes a research study that examined how users' perceptions of a learning management system (LMS) design can differ based on socio-demographic factors like gender, age, experience, and role.
The study developed a questionnaire to assess users' satisfaction with various aspects of an LMS, including navigation experience and interface design. It also measured perceptions of seven interface design factors known to potentially cause frustration, like confusing features or ambiguous terminology.
The study aimed to see if perceptions of the design factors and satisfaction measures correlated. It also tested if perceptions differed based on socio-demographic background, and if a "one-size-fits-all" design approach led to varying satisfaction levels among different user groups.
The document discusses various international standards for usability and human-centered design, including ISO 9241. It provides an overview of parts of ISO 9241 that relate to visual display requirements, usability guidance, dialogue principles, information presentation, and human-centered design processes. The document also discusses how to conduct a heuristic evaluation to identify usability issues. Examples of usability heuristics that could be used include visibility of system status, user control and freedom, error prevention, and flexibility of use.
This document discusses different types of prototypes used at various stages of the design process. It defines a prototype as an early embodiment of a design concept. Low-fidelity prototypes include sketches, wireframes, paper prototypes and storyboards, which are fast and inexpensive ways to get early feedback. Medium and high-fidelity prototypes include click-through prototypes and mockups, which more closely resemble the final product. The document emphasizes that prototyping and testing solutions early allows for continuous iteration to refine designs based on user feedback.
This document summarizes Farrukh Sahar's work portfolio, which includes experience conducting various user experience research studies and publishing the results. Some of the studies included comparing electronic diary and UX curve evaluation methods, identifying user experience factors of a sports product, and investigating mobile communication technologies for the elderly. Farrukh has expertise in interviews, surveys, usability testing, and longitudinal evaluation methods. They have published research papers in conferences and journals and participated in graduate courses related to user experience research methods.
The document summarizes the process taken to redesign the Safe Work Australia website. It involved:
1) Analyzing user data and feedback to understand issues with the existing site like poor search and navigation.
2) Benchmarking other regulatory sites and identifying areas for improvement.
3) Creating user personas and testing prototypes with users to refine the information architecture and design.
4) Developing high-fidelity prototypes in HTML/CSS that dramatically improved task success rates in user testing.
5) Finalizing the redesign following the Digital Transformation Office process to create an optimal user experience for the new site.
Using Expert Evaluation to Assess the Usability of an Educational Mobile Game...Jorge Luis Pérez Medina
The labor market inclusion of people with intellectual dis- abilities is one of the main concerns of current societies. Non-profit associations make every-day efforts to improve the living conditions of these citizens. This contribu-tion presents a heuristic evaluation of an educational mobile game helping social workers and health professionals in their training in order to incorpo-rate into the labor market citizens with intellectual disabilities. The applica-tion provides technological support for cognitive skills training and is aimed at people with mild to moderate intellectual disability and who do not present physical difficulties that prevent the normal use of a mobile device. We use a development process that combines the iPlus methodology together with a collaborative user-centered approach. Suggested recommendations based on the results can improve the usability of the game developed.
This document compares fingerprint authentication to behavioral biometric authentication using 2D and 3D gestures on smartphones. The authors developed Android apps to test each method and collected data from 6 participants over 5 days. Preliminary results found that fingerprint authentication had the highest accuracy overall, while accuracy of gesture authentication varied significantly between users and gesture types. More data is needed to better understand the potential for gesture biometrics.
This document summarizes a student's dissertation on developing a Smartboard application to collect and gather data from children. The dissertation introduces the research background and problems, establishes goals and objectives, reviews relevant literature, and describes the development and evaluation of a Smartboard application prototype. Testing with children provided results and findings, allowing the student to suggest the Smartboard can be an effective method for collecting data from children in an enjoyable way.
Situational analysis of the subjective well-being of university software deve...IJAEMSJORNAL
Integral well-being is vital for the optimal functioning of people. The requirements for a software developer in the performance of their professional activity are varied and complex. These requirements range from working in multidisciplinary and multilingual teams, going through the challenge of technological advances of the discipline to commit to quality and innovation. To face these demands, it is essential that the developers have an optimal functioning, where the experience emotional and satisfaction with life play an important role. The objective of this article is to analyze the subjective well-being of university software developers in Puebla. The research is a quantitative cross-correlation study to identify statistically significant relationships between the different welfare variables. The study involved 47 university software developers from the city of Puebla. We use Pearson's multivariate correlation to validate the instruments and find relationships between variables, and Chi-squared statistics to calculate the dependency between them. The results reveal that the university software developers experience with higher incidence and intensity, the positive affections over the negatives. The affective balance (Net Affect), calculated as the difference of the weighted averages by duration between positive affective states and negative, was positive (mean = 1.31). "Concentrated" is the positive affective state with the highest incidence and with the highest reported intensity. "Tired" is the most experienced negative affect and highest in intensity. Developers spend 40% of their time experiencing negative affective states (U-index) and are moderately satisfied with their lives in general.
HELPING PEOPLE WITH DOWN SYNDROME THROUGH AN USABILITY TESTING GUIDE PROPOSAL...ijcseit
The usability testing of mobile applications involving persons with Down syndrome is an issue that has not
be comprehensively investigated and there is no single proposal that takes on board all the issues that
could be taken into account[1]. This study aims to propose a practical guide ¨USATESTDOWN¨ to measure
and evaluate the usability of mobile applications focusing on Down syndrome users and their primary
limitations. The study starts with an analysis of existing methodologies and tools to evaluate usability and
integrates concepts related to inspection and inquiry methods into a proposal. The proposal includes the
opinions of experts and representative users; their limitations, the applicability during the development
process and the accessibility. This guide is based on the literature review and the author’s experience in
several workshops where persons with Down syndrome used mobile devices.
1 Evaluating Mobile Applications A Spreadsheet Case .docxfelicidaddinwoodie
1
Evaluating Mobile Applications: A Spreadsheet Case
Study
Derek Flood, Rachel Harrison, Claudia Iacob*, David Duce
1Oxford Brookes University,
[derek.flood, rachel.harrison, iacob, daduce]@brookes.ac.uk
ABSTRACT
The power of mobile devices has increased dramatically in the last few years. These devices are becoming more
sophisticated and allow users to accomplish a wide variety of tasks while on the move. The ease with which
mobile apps can be created and distributed has resulted in a number of usability issues becoming more
prevalent. This paper describes the range of usability issues encountered at all stages of the mobile app life
cycle, from when users begin to search for an app to when they finally remove the app from their device. Using
these results we developed a number of guidelines for both app developers and app platform developers that
will improve the overall usability of mobile apps.
Keywords: Mobile technology, portable computing, application process model, mobile usability.
1 INTRODUCTION
Advances in technology have allowed a range of sophisticated devices to emerge which enable users
to perform a variety of tasks in a mobile context. These tasks include both tasks which were
previously only available on traditional desktop applications and tasks that are only enabled by the use
of mobile devices. To facilitate these tasks a wide range of mobile applications, referred to here as
apps, are available from easy to install locations, such as the App store provided by Apple or the
Android Marketplace provided by Google. In order to improve the portability of both of these types of
apps, a number of compromises are necessary. These compromises, such as smaller screen size, more
limited processing power and the mobile context in which the device is used, have frequently had a
negative effect on the usability of these apps. The compromises can most readily be seen during the
use of mobile apps. There has been a large amount of research into the usability of specific mobile
apps (Ahmadi, 2008; Geven, 2006; Schmield, 2009; Shrestha, 2007). However, little research has
been conducted on the selection, installation and removal of mobile apps, all of which can be
problematic. This paper presents a study in which we examined aspects of user interaction with
mobile apps during various steps in the usage lifecycle of mobile applications: application
identification, installation, usage, and removal. To illustrate the range of interactions that a user may
have with a mobile app we also present a mobile app process model which shows the typical life cycle
of a mobile app.
This paper is structured as follows. Section 2 describes related work. Section 3 addresses user
interaction with mobile devices. Section 4 of the paper outlines the case study conducted to
investigate the usability of mobile applications at various steps in their lifecycle. Based on this
investigation, a set of guidelines ...
A Critical Evaluation of Popular UX Frameworks Relevant to E-Health Appsrinzindorjej
This research paper aims to evaluate the usability, accessibility, and effectiveness of the current User Experience (UX) frameworks relevant to mobile health apps, with a specific focus on the FitBit app. The selected UX frameworks for evaluation include Nielsen Norman Group's 10 Usability Heuristics, Don Norman's Three Levels of Design, and Human-Centered Design. A mixed-method approach, comprising both qualitative and quantitative analyses, was employed to evaluate these frameworks. The FitBit app was assessed based on the selected frameworks, and the obtained results were compared with existing literature and industry standards. The main subject of this study is the critical evaluation of popular UX frameworks in the context of e-health apps, with a specific emphasis on the FitBit app. The evaluation factors considered include usability, accessibility, and effectiveness. By utilizing the selected UX frameworks, the paper seeks to identify the strengths and limitations of each framework in evaluating e- health apps. The achieved results reveal that Nielsen Norman Group's 10 Usability Heuristics are valuable in identifying usability issues within the FitBit app. Don Norman's Three Levels of Design effectively evaluate the overall user experience, providing insights into the app's design quality. Human- Centered Design, on the other hand, offers a comprehensive and holistic approach to designing for the user, encompassing various aspects of the FitBit app. Through this research, a comprehensive understanding of the strengths and limitations of the evaluated UX frameworks in relation to e-health apps, specifically the FitBit app, is attained. The findings contribute to the existing literature on UX evaluation and provide insights for designers and developers to enhance the user experience of mobile health applications.
The International Journal of Computational Science, Information Technology an...rinzindorjej
The International Journal of Computational Science, Information Technology and Control Engineering (IJCSITCE) is an open access peer-reviewed journal that publishes quality articles which make innovative contributions in all areas of Computational Science, Mathematical Modeling, Information Technology, Networks, Computer Science, Control and Automation Engineering. IJCSITCE is an abstracted and indexed journal that focuses on all technical and practical aspects of Scientific Computing, Modeling and Simulation, Information Technology, Computer Science, Networks and Communication Engineering, Control Theory and Automation. The goal of this journal is to bring together researchers and practitioners from academia and industry to focus on advanced techniques in computational science, information technology, computer science, chaos, control theory and automation, and establishing new collaborations in these areas.
The International Journal of Computational Science, Information Technology an...rinzindorjej
The International Journal of Computational Science, Information Technology and Control Engineering (IJCSITCE) is an open access peer-reviewed journal that publishes quality articles which make innovative contributions in all areas of Computational Science, Mathematical Modeling, Information Technology, Networks, Computer Science, Control and Automation Engineering. IJCSITCE is an abstracted and indexed journal that focuses on all technical and practical aspects of Scientific Computing, Modeling and Simulation, Information Technology, Computer Science, Networks and Communication Engineering, Control Theory and Automation. The goal of this journal is to bring together researchers and practitioners from academia and industry to focus on advanced techniques in computational science, information technology, computer science, chaos, control theory and automation, and establishing new collaborations in these areas.
ER Publication,
IJETR, IJMCTR,
Journals,
International Journals,
High Impact Journals,
Monthly Journal,
Good quality Journals,
Research,
Research Papers,
Research Article,
Free Journals, Open access Journals,
erpublication.org,
Engineering Journal,
Science Journals,
Engineering Research Publication
Best International Journals, High Impact Journals,
International Journal of Engineering & Technical Research
ISSN : 2321-0869 (O) 2454-4698 (P)
www.erpublication.org
A Conceptual Design And Evaluation Framework For Mobile Persuasive Health Tec...Kate Campbell
This document presents a conceptual framework for designing and evaluating the usability of mobile persuasive health technologies. It begins with an introduction on the increasing popularity and use of mobile health apps but also notes that evaluating these apps, particularly with regards to usability, remains a challenge.
The document then reviews existing models for evaluating usability, including the Persuasive Systems Design (PSD) model, various usability models like ISO and Nielsen, and integrated models like PACMAD. It notes that while PSD is useful for design, it is limited for evaluation as its principles are subjective and cannot be easily quantified.
The paper then proposes extending the PSD model with an integrated usability model and using fuzzy analytic hierarchy process to
This document describes a virtual supermarket simulator application created by Emil Rosenlund Høeg and Luca Mangano. The application was developed for Aalborg University's Integrated Food Studies program as a tool to study consumer behavior and decision making in a virtual environment. A usability test was conducted with 17 participants to evaluate the application based on learnability, effectiveness, efficiency, errors, and satisfaction. The results showed that participants felt limited by the application's current functionality but provided suggestions for improvements to enhance the experience. The project demonstrated potential for a virtual simulation tool but requires further refinement of the user interface, textures, and interaction techniques to achieve its goals.
Human computer interaction (HCI) is concerned with the practice of usability, which is a measure that
evaluates the simplicity of using a system, software, or interface design for performing particular tasks.
Evaluation is a process by which designers gather information about a systems usability to improve its user
interfaces features. This research presents a study of a usability evaluation of EduGate, an online
academic portal of King Saud University. In this research the heuristic evaluation method was chosen to
evaluate the usability of the EduGate. Our results show that, the EduGate suffers from certain usability
problem and some recommendations were proposed to enhance the usability of the EduGate. A
questionnaire was then used to collect the feedback of real users (i.e. students) on the value of these
recommendations. The participants supported 80% of the proposed recommendations to improve the
usability of the EduGate.
Human computer interaction (HCI) is concerned with the practice of usability, which is a measure that evaluates the simplicity of using a system, software, or interface design for performing particular tasks. Evaluation is a process by which designers gather information about a systems usability to improve its user interfaces features. This research presents a study of a usability evaluation of EduGate, an online academic portal of King Saud University. In this research the heuristic evaluation method was chosen to evaluate the usability of the EduGate. Our results show that, the EduGate suffers from certain usability problem and some recommendations were proposed to enhance the usability of the EduGate. A questionnaire was then used to collect the feedback of real users (i.e. students) on the value of these recommendations. The participants supported 80% of the proposed recommendations to improve the usability of the EduGate.
A HEURISTIC-BASED APPROACH FOR USABILITY EVALUATION OF ACADEMIC PORTALSijcsit
Human computer interaction (HCI) is concerned with the practice of usability, which is a measure that evaluates the simplicity of using a system, software, or interface design for performing particular tasks. Evaluation is a process by which designers gather information about a systems usability to improve its user interfaces features. This research presents a study of a usability evaluation of EduGate, an online academic portal of King Saud University. In this research the heuristic evaluation method was chosen to evaluate the usability of the EduGate. Our results show that, the EduGate suffers from certain usability problem and some recommendations were proposed to enhance the usability of the EduGate. A questionnaire was then used to collect the feedback of real users (i.e. students) on the value of these recommendations. The participants supported 80% of the proposed recommendations to improve the usability of the EduGate.
Paper Gloria Cea - Goal-Oriented Design Methodology Applied to User Interface...WTHS
This document describes a user interface designed for a mobile application called the Functional Assessment System (FAS). The FAS allows users to assess their aerobic fitness on their own without specialized equipment. The design of the mobile application interface was guided by the Goal-Oriented Design methodology. This methodology focuses on representing users as characters with specific goals and designing scenarios to help users achieve those goals. The document also discusses evaluating the usability of the interface using the AttrakDiff questionnaire to assess pragmatic and hedonic qualities. The results showed satisfactory user interaction with the FAS mobile application interface.
A METHOD FOR WEBSITE USABILITY EVALUATION: A COMPARATIVE ANALYSISIJwest
ABSTRACT
Graphical user interfaces design in software development process focuses on maximizing usability and the user's experience, in order to make the interaction for users easy, flexible and efficient. In this paper, we propose an approach for evaluating the usability satisfaction degree of a web-based system. The proposed method has been accomplished in two phases and implemented on an airlines website as a case study. In the first phase, a website usability test is implemented by a number of users, and then the results obtained are translated into charts for a final web-based system evaluation in the second phase. The results achieved
were satisfactory, since the places where the weaknesses and gaps in the website are identified and recommended solutions to avoid them are drawn. The authenticity of the results have been confirmed by comparing them with user opinions acquired from a questionnaire, which proves the precision in which the website is rated.
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Waqas Tariq
The growth of the Internet and related technologies has enabled the development of a new breed of dynamic websites and applications that are growing rapidly in use and that have had a great impact on many businesses. These websites need to be continuously evaluated and monitored to measure their efficiency and effectiveness, to assess user satisfaction, and ultimately to improve their quality. Nearly all the studies have used Heuristic Evaluation (HE) and User Testing (UT) methodologies, which have become the accepted methods for the usability evaluation of User Interface Design (UID); however, the former is general, and unlikely to encompass all usability attributes for all website domains. The latter is expensive, time consuming and misses consistency problems. To address this need, new evaluation method is developed using traditional evaluations (HE and UT) in novel ways.
The lack of a methodological framework that can be used to generate a domain-specific evaluation method, which can then be used to improve the usability assessment process for a product in any chosen domain, represents a missing area in usability testing. This paper proposes an adapting framework and evaluates it by generating an evaluation method for assessing and improving the usability of a product, called Domain Specific Inspection (DSI), and then analysing it empirically by applying it on the educational domain. Our experiments show that the adaptive framework is able to build a formative and summative evaluation method that provides optimal results with regard to the identification of comprehensive usability problem areas and relevant usability evaluation method (UEM) metrics, with minimum input in terms of the cost and time usually spent on employing UEMs.
User Experience Evaluation for Automation Tools: An Industrial ExperienceIJCI JOURNAL
Evaluating the User Experience in some contexts is challenging, especially in automation applications, due to specific situations and requirements. This paper presents an experience of applying the UX evaluation method for an automation tool in the Android software industry to assist software engineers in identifying the UX problems faced by users. The work applies heuristic evaluation, survey, and user interview methods to find the UX problems, understand the respective reasons, validate the given information, and finally assess the UX. The evaluation identified critical problems related to error messages, system response to errors, and proper feedback about what software is doing. The found problems and discussions contributed to developing new UX evaluation methodologies.
USABILITY TESTING PROCESS WITH PEOPLE WITH DOWN SYNDROME INTREACTING WITH MOB...ijcsit
We present a review of research related to the usability testing of mobile applications including
participants with Down syndrome. The purpose is to identify good usability testing practices and possible
guidelines for this process when participants are people with this cognitive disability. These practices and
guidelines should account for their specific impairments. We applied document analysis techniques to
searches of scientific databases. The results were filtered considering how well they matched the research
topic. We processed and reported the classified and summarized results. The main findings of this literature
review is that mobile applications usability testing including people with Down syndrome is an issue that
has not be comprehensively investigated. While there is some related research, this is incomplete, and there
is no single proposal that takes on board all the issues that could be taken into account. Consequently, we
propose to develop guidelines on the usability testing process involving participants with Down syndrome.
Principles of Health Informatics: Evaluating medical softwareMartin Chapman
Principles of Health Informatics: Evaluating medical software. Last delivered in 2023. All educational material listed or linked to on these pages in relation to King's College London may be provided for reference only, and therefore does not necessarily reflect the current course content.
2012 in tech-usability_of_interfaces (1)Mahesh Kate
This document discusses usability of interfaces and provides three key points:
1. It defines usability and outlines several principles and heuristics for designing usable interfaces, including consistency, feedback, and reducing cognitive load.
2. It summarizes international usability standards like ISO 9241-11 that emphasize evaluating usability based on effectiveness, efficiency, and satisfaction within a usage context.
3. It describes user-centered design as a methodology focused on understanding users and specifying requirements to produce designs that are then evaluated iteratively.
Interface on Usability Testing Indonesia Official Tourism WebsiteWaqas Tariq
Ministry of Tourism and Creative Economy of The Republic of Indonesia must meet the wide audience various needs and should reach people from all levels of society around the world to provide Indonesia tourism and travel information. This article will gives the details in the evolution of one important component of Indonesia Official Tourism Website as it has grown in functionality and usefulness over several years of use by a live, unrestricted community. We chose this website to see the website interface design and usability and to popularize Indonesia tourism and travel highlights. The analysis done by looking at the criteria specified for usability testing. Usability testing measures are the ease of use (effectiveness, efficiency, consistency and interface design), easy to learn, errors and syntax which is related to the human computer interaction. The purpose of this article is to test the usability level of the website, analyze the website interface design, and provide suggestions for improvements in Indonesia Official Tourism Website of analysis we have done before.
Similar to HELPING PEOPLE WITH DOWN SYNDROME THROUGH AN USABILITY TESTING GUIDE PROPOSAL FOR MOBILE APPLICATIONS (20)
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...EduSkills OECD
Andreas Schleicher, Director of Education and Skills at the OECD presents at the launch of PISA 2022 Volume III - Creative Minds, Creative Schools on 18 June 2024.
How Barcodes Can Be Leveraged Within Odoo 17Celine George
In this presentation, we will explore how barcodes can be leveraged within Odoo 17 to streamline our manufacturing processes. We will cover the configuration steps, how to utilize barcodes in different manufacturing scenarios, and the overall benefits of implementing this technology.
Leveraging Generative AI to Drive Nonprofit InnovationTechSoup
In this webinar, participants learned how to utilize Generative AI to streamline operations and elevate member engagement. Amazon Web Service experts provided a customer specific use cases and dived into low/no-code tools that are quick and easy to deploy through Amazon Web Service (AWS.)
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptxCapitolTechU
Slides from a Capitol Technology University webinar held June 20, 2024. The webinar featured Dr. Donovan Wright, presenting on the Department of Defense Digital Transformation.
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...TechSoup
Whether you're new to SEO or looking to refine your existing strategies, this webinar will provide you with actionable insights and practical tips to elevate your nonprofit's online presence.
A Free 200-Page eBook ~ Brain and Mind Exercise.pptxOH TEIK BIN
(A Free eBook comprising 3 Sets of Presentation of a selection of Puzzles, Brain Teasers and Thinking Problems to exercise both the mind and the Right and Left Brain. To help keep the mind and brain fit and healthy. Good for both the young and old alike.
Answers are given for all the puzzles and problems.)
With Metta,
Bro. Oh Teik Bin 🙏🤓🤔🥰
HELPING PEOPLE WITH DOWN SYNDROME THROUGH AN USABILITY TESTING GUIDE PROPOSAL FOR MOBILE APPLICATIONS
1. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
DOI : 10.5121/ijcseit.2017.7201 1
HELPING PEOPLE WITH DOWN SYNDROME THROUGH AN
USABILITY TESTING GUIDE PROPOSAL FOR MOBILE
APPLICATIONS
Doris Cáliz1
, Loïc Martínez1
, Richart Cáliz2
.
1
Department ETSIINF, DLSIIS, Madrid Polytechnic University, Campus de
Montegancedo 28660 , Boadilla del Monte , Madrid, Spain
2
Department of Computer Sciences FIS Group, National Polytechnic University, Ladrón
de Guevara E11-25 y Andalucía Quito, Ecuador
ABSTRACT
The usability testing of mobile applications involving persons with Down syndrome is an issue that has not
be comprehensively investigated and there is no single proposal that takes on board all the issues that
could be taken into account[1]. This study aims to propose a practical guide ¨USATESTDOWN¨ to measure
and evaluate the usability of mobile applications focusing on Down syndrome users and their primary
limitations. The study starts with an analysis of existing methodologies and tools to evaluate usability and
integrates concepts related to inspection and inquiry methods into a proposal. The proposal includes the
opinions of experts and representative users; their limitations, the applicability during the development
process and the accessibility. This guide is based on the literature review and the author’s experience in
several workshops where persons with Down syndrome used mobile devices.
KEYWORDS
Usability Testing, Mobile Applications, Cognitive Disability, Down Syndrome, Human Computer
Interaction (HCI), Mobile Devices.
1. INTRODUCTION
Down syndrome (DS) is a genetic disorder with a worldwide incidence close to one in every 700
births but the risk varies with the mother’s age. Persons with DS have impaired cognitive
processing, language learning and physical abilities, as well as different personal and social
characteristics [11]. Because Persons with DS have special characteristics, they need high levels
of usability of the products they use. A usability testing methodology suitable for participants
including persons with DS needs to be well designed taking on count their special skills [12].
The International Organization for Standardizations (ISO) bases usability on three main
attributes: effectiveness, efficiency and satisfaction. Systems with good usability are easy to learn,
efficient, not prone to errors and generate user satisfaction [10].
Testing products with representative users is a key factor for user-centred design. When such
representative users are persons with disabilities the user testing process becomes a challenge and
in this case evaluation methods based on heuristics and inspection could not attend the final user
needs [3].
Persons Persons with Down syndrome have many difficulties to use the mouse and the keyboard
because they have fingers shorter than usual [4]. Multi-touch technology helps to solve this
problems when people use devices, such as mouse, keyboard or joystick, and enables users to
take advantage of the direct manipulation interaction and the benefits of direct touch [9]. There
are a big range of functional abilities in individuals with Down syndrome, related to the extent of
2. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
2
impairment in the sensory and motor channels [5], memory, and cognition and communication
skills [6]. These sensory and motor issues would need to be taken into consideration when
researchers want to evaluate a mobile application in individuals with Down syndrome.
The authors have performed a detailed research on articles related with this topic and they have
not found a guide to support the usability testing process for mobile applications focused on
persons with Down syndrome [7]. After that, they they have evaluated the use of a tool called
“Gestures” by a group of 100 persons with DS. The goal was to analyse the skills of these persons
to perform basic gestures [8]. The authors found that DS children 5 to 10 year-old are able to
perform most of the evaluated multi-touch gestures with success rates close to 100 per cent. This
research study is designed to be a preliminary investigation of how users with Down syndrome
could potentially utilize touch-screens gestures tasks to obtain a sense of some of the potential
challenges to effective use of tablet computers for this population and to investigate how usability
testing involving Persons with Down syndrome could be effectively performed. [9].The result of
combining the literature review and the research experience in several workshops is the guide to
perform usability testing when the participants are persons with DS. This guide is called
“USATESTDOWN”.
Where is USATESTDOWN
In the Human Computer Interaction area one of the most commonly used design philosophies to
create high quality products for users is the User-Centred Design (UCD) approach[2] UCD refers
to the philosophy that the intended user of a product should always be in the centred of the design
process throughout all phases of the design[3]. Usability testing, according to Dumas & Redish
[4], aims to achieve the following five goals, to: Improve the product’s usability, Involve real
users in the testing, give the users real tasks to accomplish, Enable testers to observe and record
the actions of the participants, Enable testers analyse the data obtained and make changes
accordingly. USATESTDOWN is inside Evaluate the Design Requirements as we can see in Fig
1.
Figure 1: Process of User centred Design.
2. RELATED WORK
a. Usability evaluation methods
There are three types of usability evaluation methods: observational, analytical and inquiry
evaluation methods [5]. Evaluation methods that collect datºa by observing users’ experiences
with a product are called observational evaluation methods. Usability testing, user-oriented view
3. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
3
and user performance testing are types of observational evaluation methods [6]. Methods that do
not collect data from users’ experiences but rely on the opinion of experts are called inspection or
analytical evaluation methods. These methods have a product-oriented view. Examples of
analytical evaluation methods are Heuristic Evaluation [7] Cognitive Walkthrough and Semiotic
Inspection [8]. Inquiry methods have a user-oriented view. Inquiry methods tend to identify broad
usability problems or opinions about a product as a whole such as user Satisfaction
Questionnaires and Focus Groups [9].
Usability Evaluation methods for mobile applications focused on persons with Down syndrome
While there is some related research, it is incomplete. Devan does not consider mobile or touch
screen devices. The author used an application called JECRIPE, this application works in a PC.
Additionally it is not a Usability Testing Guide [10]. Kumin and Lazar did a usability evaluation
to understand potential interface improvements and they suggest different tips to evaluate
usability but it is not a Usability Test guide [11]. AR BACA SindD is a usability evaluation
framework for an augmented reality framework for learners with DS but they did a specific
evaluation in AR Systems but it is not a Usability test guide [12]. Adebesin, Kotzé show the
important role of two evaluation methods in the usability [13.]The authors did not speak about
touch screen, usability guide etc. (MEL-SindD) discusses the usability assessment of the
courseware but it is not focus on mobile applications [14]
b. Working Method Overview
The guide reproduces the usual usability testing steps. The guide provides recommendations
taking into account the needs of people with DS in the usability testing process.
In general, the working method has four main phases, as shown in Fig. 2. The process is iterative.
Figure 1: Working Method Overview
• Theoretical analysis. A state of the art on usability testing involving persons with Down
syndrome.
• Experimental analysis. There have been made experiments on usability testing with
persons with Down syndrome.
• The guideline “USATESTDOWN”: This phase consists on the preparation of a guideline
to perform usability testing involving persons with Down syndrome. The contents of the
guideline, called “USATESTDOWN” are based on the results of phases 1 and 2. The
development of the guideline will be iterative. Observational evaluation has been chosen as
the method to be used in the usability testing.
4. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
4
• Evaluation of “USATESTDOWN”: The USATESTDOWN guideline will be evaluated
with a set of experiments involving persons with Down syndrome in usability testing of
mobile applications. The results of the evaluation will be used to improve the guideline.
c. Usability testing previous contributions for mobile applications focused on
persons with Down syndrome
The most common method for evaluating how usable a product or system is usability testing,
which involves testing prototypes with real users [4]. Participating users are given a set number of
tasks that they have to perform using a prototype or a full system. Data on the effectiveness,
efficiency and satisfaction of users are collected during testing. Generally, the usability process is
divided into the following steps: 1. Recruit participants, 2. Establish the tasks, 3. Write the
instructions, 4. Define the test plan, 5. Run the pilot test, 6. Refine the test plan, 7. Run the test
session, 8. Analyse the collected objective, and 9. Report results.
We found 5 articles related with our topic after a Literature Review research. We used the
definition of the main steps of usability testing [15] to analyse the contributions of each author on
each usability testing step. We took the authors contributions in each point [7], [8], [9], [10], [11].
But is important notice they contribute only with the steps 1, 2, 3, 5, 7, 8, the steps 4, 6, 9 were
deleted because there are not contributions. We had the results in table 1. We can see there are
several empty spaces, meaning that there are not contribution in those specific steps.
Table 1 Previous contributions of usability testing
Paper
1.
Participants
2. Tasks 3.
Instructions
5. Pilot
testing
7.
Testing
8.
Analyse
[10]2013 X X X
[13]2010 X X X. X
[12]2011 X X
[11]2012 X X
[14]2009 X X X X
There is not a Guide to evaluate Usability in mobile applications focused on Down syndrome
person. Consequently, the authors proposed the need to develop guidelines on the usability testing
process in mobile applications involving participants with Down syndrome.
d. Collected Experience
USATESTDOWN is a guide to support usability testing of mobile applications when the
participants are persons with DS. It has been developed by combining information collected from
a literature review [15] and experience acquired during four workshops with approximately 100
people with DS [16][17]. We performed several workshops in different Special Dow Syndrome
Centre in Spain (Asindown [16], Maria Corredentora [17], Apadema [18], Prodis [19]) as we
show in the figure 1. We evaluated 122 persons, 69 children and 53 adults with Down syndrome
to determinate the skills, behave and how they interact with mobile devices.
5. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
5
Figure 3: Collected Experience
3. ¨USATESTDOWN¨ GUIDE PROPOSAL
USATESTDOWN is a guide to help usability tests of mobile applications focused on users with
Down syndrome. Applying the usability testing guide USATESTDOWN, the evaluators can
easily manage the usability test with applications on mobile devices for persons with Down
syndrome in the different workshops following the different steps that the guide proposes. We
describe the 9 steps of USATESTDOWN recommend for the authors, such as: [23], [24], [25],
[24], and [26]. We describe this guide with specific activities in order to evaluate Mobile
applications software focused on persons with Down syndrome. The flow of the process was
adjusted to account for the reality of the persons with Down syndrome. We showed in Fig, the
USATESTDOWN Guide process.
Figure 4: Process of Usability Testing as defined in USATESTDOWN
After the USATESTDOWN figure scheme we have 4 tables from number II until X with the
following information:
• Step: The step name based on the Usability Test process
• Definition: According with the authors [18], [19], [20] what we should expect in this
point.
6. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
6
• Bibliography Research:
Bibliography Suggestion: A collection about what the authors propose in this step
[7] [8] [9] [10] [11].
Real Experience: The real results obtained after to apply the author guideline. It is
the information collected with several workshops, it means the experience that we
collected with this experiments. The workshops were explained on chapter 2.
• Usatestdown:
UsatestDown Guideline : Contribution of the proposal Guide. This part contain
the experience before and after to create UsaTest down because we tested the
proposal guide with several workshops and we improve every time making finally
a complete guide.
Got From Experience : The experience we had after perform the workshops and
the reason why we propose the guideline. It is the justification or reason to
propose the recommendation. This
• Documents: Documents to support the step adapted specially to persons with DS.
1. Establish the tasks.
Establish the tasks
Table 2: Usatestdown:
7. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
7
2. Write the instructions
Table 3: Usatestdown: Write the instructions
3. Define the test plan
Table 4: Usatestdown: Define the test plan
USATESTDOWN
Step : Define the test plan
Definition It is necessary to specify the protocol with alternative activities, such as, welcome, interview preview,
completing the tasks by observing the user, satisfaction questionnaire, personal interview to collect
qualitative information, etc. It is recommended to write an introductory commentary to express a welcome
to the users. It is necessary, as part of these instructions, to collect the data needed by the users to complete
the tasks.
Bibliography
Research:
BIBLIOGRAPHY SUGESTION REAL EXPERIENCE
[20] The evaluation was done on the
users on a one-to-one basis.
It was necessary evaluate every participant on a individual
way otherweise they lost the concentration. They need many
attention and support.
Usatestdown USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
• The demographic survey must have
only general information not lasts names.
• It is necessary to complete a demographic survey including
name, age, gender, experience with mobile devices. It must to
have only general information, even it could use a fake name
because family, tutors and participants are so reserved wit
information that it would allow them to be identifier. Never
take last names. Don’t push the persons to answer if they don’t
want, it may generate a bad atmosphere to work. This is like
the test that was used in the workshops and can be found in
Annex 1. It should be completed by the evaluator.
• Aplly the User satisfaction survey only
with 3 answers . USATESRDOWN tets
is recommended.
• It is important to prepare a user satisfaction survey with a
scale of no greater than 3 categories and, if possible, with
graphics of faces (happy, neutral, sad). We tried to work with
5 answers but it was confusing to the participants. Aditionally
we had a meeting with the students psicologist supervisors and
they also recommended only 3 levels
• Don’t use documents with text to the
participants. If you need to give
documents it is better with graphics or
don’t not use documents
• Avoid providing documents with long text to the persons
who will participate in the test Generally, persons with DS
have vision problems and it is taxing for them to read and
speak. It is recommended that the instructions be given
verbally and in a graphic form that is simple, allowing them to
understand the information. In the first workshop session , we
wrote test to explain to the participants the steps that they
should follow but they had probles to read or pronunce and to
understand. It si better to avoid
• Write short questions only with 3
answers
• Write short questions only with 3 answers (not, may be, yes),
in this specific order because if they find fist the option YES
they will not read the rest of te options. If you want to ask
about quantity answer posibility is (few, many, too many). It
means only 3 answers.
8. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
8
• Write questions focused on the
applications and try to make understand
the participants how important is to say
the truth
• The participants are likely to provide friendly answers
whether or not they like the application because they tend to
be friendly persons. Persons with Down Syndrome are so
friendly and they like to make friends, this is their normal
behaviour, we had seeral cases with participants whoes answer
the questionary saying the aplication was esy to understand,
but when we analized the results with the log aplicaction the
participants could not get success on the task or the success
level was so low. Aditionally when we asked Did you like the
aplication ?’ No body said NO, it showed us that it was not the
rally truth. The wanted just to be friendly.
• Participation of the expert tutors is
requiered
• The participation of the expert tutors is very important as
their experience greatly contributed to the implementation of
the test, following the guide. Additionally, it is critically
important to include the expert tutors with the interaction with
the participants’
• The sessions will be facilitated and
observed by only one facilitator to one
participant
• It is because on the workshops the participants were shy
when they see many new persons in the room.
• Persons need to be encouraged to
participate and facilitator should stress
the value of the child’s input and show
appreciation and gratitude.
• This is a task that the facilitator should do. People with DS
like to feel they are helping to another people. They will feel
motivated.
• The educators of people with DS should
be present at the moment of perform the
sesion.
• This is very necessary on the sesion because the articipants
will feel sure and with a high confidence level.
• Give the participant the device for long
time to execute the game (or task) task at
home. Application should have a datalog
to record.
• We suggest an evaluation stage where devices are given back
to them to determine how much time is necessary for them to
work independently from the tutors and then independent of
the application and able to do the activity without the support
of a tutor or the application.
• Apply at least 2 evaluation methods • It means oservational method to analise the user behaviour
and the tool should have a log or a way to evaluate if the task
was completed susscesfully or not, aditionally you shoul use a
satisfaction cuestionary, in this case the proposal recommend
the SUS Questionary adapted to persons with Down
Syndrom.
• Establish objective metrics with a
completion time for the task, error rate,
etc.
• Performing the workshops we could notise the time is not a
good parameter to take on count because when we said
persons with down syndrome participants that they should do
the task on a specific time, inmediatly they were scared becase
they thought is an evaluation about how smart they are and it
is obviosly a big problem even to persons without down
syndrome .
• The participants should have pre
training about the aplication
•
It mens tutor should teach to the participants how the
aplication work and the should interact par minutes with the
aplication before the real test.
• Establish subjective metrics such as
sucess, frustration, satisfaction, etc.
• While the participants are using the application. Success:
Defined as the completion of a task done correctly and without
help. Satisfaction: When the user gets the correct result easily,
when the user shows happiness when interacting with the
application, etc. Frustration: When the user has problems
answering a tutor’s questions, when the user gives an incorrect
answer, when the user doesn’t understand the process, etc.
• Schedule a break halfway • It means , through the test session and remind the participants
that they can stop at anytime. Don’t push participants
• Record videos about the participants
sesions but without faces.
• To evaluate Success, frustration, satisfaction you could use
the videos recorder during the workshop or sesion or at te
same time the tutor could take on count measure of every
tasks , how many times the participant showed this reaction.
• Hold a meeting prior to executing the
test
• Because it is very important to break the ice with the
participant so that they feel safe and trusting of the process at
the workshop, This is a way to make friendly and relaxin the
work enviroment
9. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
9
• Observation method needs facilitator to
record all children action, behaviours and
facial expressions while observing
children playing the game.
• In order to guide facilitator, an observation checklist is
needed to analyse the participants behavoiur.
• The evaluator should evaluate every
participant on a individual way .
• The evaluatior needs to catch the participat atention, until to
be sure the participant understood the task . Some times is
necessary ask the participants to see the evaluator eyes
otherweise they focus their attention on another thing they
could see.
• Do not use the technique of “thinking
out loud”
• Because the majority of the participants have difficulty
expressing themselves
Documents The documents should be printed
-UsatestDown Demographic Questionary (Annexes)
-UsatestDown SUS Questionary adapted to persons with Down Syndrome focused
-UsatestDown SUS Questionary to Tutors focused in the whole process (Annexes )
4. Run the pilot test
Table 5: Usatestdown: Run the pilot test
USATESTDOWN
Step : Run the pilot test
Definitio
n
Execute the test protocol using the welcome, the written instructions, completing the observations, measuring times,
completing the interviews, etc. in order to analyze if the proposed process functions as expected. In the case that it is
not, it should be writen as the protocol describe.
Bibliogra
phy
Research
:
BIBLIOGRAPHY SUGESTION REAL EXPERIENCE
[19] Involve field evaluation with a
larger and more diverse user group to
assess the extent
This recommendation does not define the number . In our case we
recommend at least 10 users.
[6] Don’t use passwords We never used passwords
Usatestd
own
USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
• Record on video the interaction of
the person with the mobile device
• It is recommended and very important in order to qualitatively evaluate
their interaction with it when we review the videos. Be careful not to film
faces and to obtain authorization in order to complete this point.
• Ask for parents permission if it is
necessary to film faces,
• The evaluator should be really polite because this is a sensitive topic. Some
times is necessary the fathers autorization to record participants faces .
• To the pilot test is necessary only one
participant
• It is recommended that the pilot test is done through a small samples but in
this case it means only one person because the evaluator will notice with the
second participant the mistake will be the same. This will allow a definition
of the first process errors without needing to involve all of the participants
in the process, repeating the same error.
• The tutors or professors should be
present on the evaluation sesion.
• During the entire evaluation process or user participation, it is necessary
that the tutors or professors with whom they are interacting on a daily basis
are present and provide a sense of support as we could see in the sessions
we performed
• The facilitator will sit next to the
child during the session to take note
and solve participant questions
• The facilitator will sit next to the child during the session and his/her role
is to fill in the observation form while interacting with the child to make
them feel at ease. We rocomend the participant doesnot write himself the
questionary. They use to have problems to write or read.
• Two questionnaires need to be
assessed, they are proposed for
USATESTDOWN
• There are two questionnaires that need to be assessed which are
demographic questionnaire and post task questionnaire but we propose
specifics questionaies adapted to participants with Down Syndrome. We
designed this questionaries with Special Psicologist whoes work every day
with those participants , taking as base the SUS questionarie.
• Post task questionnaire will be
conducted right after each test session
with the help from the Tutor or
Parent
• Post task questionnaire will be conducted right after each test session with
the help from the Tutor or Parent. Is is neceary make the testas soon as
posible , not the next day because participants forget what they did.
Facilitador should be close just in case the participant have a dubt.
• Take note of the times when the
participant asks for help.
• The evaluator mus to take note of the times when the participant asks for
help.
• Take a pause • Schedule a break halfway through the test session and remind the
participants that they can stop at anytime. Don’t push to the students to do
everything at the same time.
• Use simple words when directing the
participant
• When you explain to the participants the tasks, process, objectives etc, you
should use a easy vocabulary, people with down syndrome showed they
don’t understand difficult words and they lost attention
10. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
10
Speak slowly slow and some times is
necessary repeat the same idea
• Because the participats have a problem to concentrate their attention.
Docume
nts
The documents should be applied
-UsatestDown Demographic Questionary (Annexes)
-UsatestDown SUS Questionary adapted to persons with Down Syndrome focused in the whole process
-UsatestDown SUS Questionary to Tutors focused in the whole process (Annexes )
5. Refine the test plan after analysing the results of the pilot tests.
Table 6: Usatestdown: Refine the test plan after analyzing the results of the pilot tests.
USATESTDOWN
Step : Refine the test plan after analysing the results of the pilot tests.
Definition Once analyzing the results of the pilot test, modifications may be made to the protocol, instructions, task data, task
sequencing, interview questions, etc., if necessary.
Bibliograp
hy
Research:
NO CONTRIBUTIONS
Usatestdo
wn
USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
• Validate the tasks what the
evaluator would you like to change
with the Tutors
• If an error is encountered in the test pilot, it is necessary to make an
immediate change to the plan and execute a second session but it shoul be
aproved by the DS persons Toutors because evaluator could consider
aditionals actions as normal but Tutors could have another point of view
• Write the changes will be done
and explain the reason why it was
made.
• It could help to understand the DS persons behaviour with the aplication.
It shoult take on count to make inform with the final analysis
It Is requiered a formal document
signed by the participants tutor to
make changes.
• If the inicial Test Plan has to be changed, the evaluator should have a
document signed by the Tutor with the aprobation. With persons with Down
syndrome is very important follow this rules.
6. Recruit participants
Table 7: Usatestdown: Recruit participants
USATESTDOWN
Step : Recruit participants
Definition Process to determine the type and number of participants needed for the usability tests.
Bibliograph
y Research:
BIBLIOGRAPHY SUGESTION REAL EXPERIENCE
• [17] Recomended 4 participants ,[19] 6
participants [18] 3 or 5 to five participants
• [24] work with two paediatricians, primary
school teachers and 11 children with DS.
• [6] Nielsen’s study showed that a group of
five users with different background, mixed
gender and aged five to six years old , they
were able to find about 80% of the findings
in a system.
About number of particpants We could see with smaller
groups as 2 or 3 the difference between them is big because
every student have special skills and the resuts did not
define a clear behavior pattern
In this specific case 6 persons was not enough.
Usatestdow
n
USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
• It is necessary that evaluators determine
the cognitive disabilities level of the
participants that they need , only the age is
not a parameter to be on count.
• To establish the tasks, it should be considered that the
participants have different levels of abilities and what
might be simple for one may be more complex for others.
• There should ge at least 10 participants to
the evaluation
• We could see with smaller groups as 2 or 3 the difference
between them is big because every student have special
skills and the resuts did not define a clear behavior pattern.
• Send clear information about the session
objective to the Technology Department, if
they are ineterested on the research and they
could find a aportation to the centre they
would contact with the Directives
explaining the advantages they could have.
• The first step in recruiting young participants is sending
information about the study to the places whoes are
working with the particpants profile that we want to work, it
means, tere are differents kinds of Centres working with
down Syndrome depending of the students levels skills.
11. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
11
• Evaluator and Tutor should have a meeting
to define the participant profile and tutor
should recommend the particcipants proffile
to make the task that the evaluator
proposed.
• We should not only take on count the participants age, we
should analize what are the especial skils that every
participant have. In our case at the beginning we found
participants with low mental dishabilities and another so
extrem. It makes not homogeneous group because we were
not evaluating really the aplication, we were evaluating just
the cognitive disabilities.
• The facilitator should ask the participant if
he/she wants to colaborate
• Because the participant should be voluntier. We had a case
with a participant who behaved on a rude way . We asked
him if he want to participate and he did not want. It is the
best way to evaluate because some times they feel pushed
to contribute. The not willing participant could change the
evaluation results
•Don’t push them to finish fast. •Partcipants neet to take their time, if they take more more
time than the programated time just tell him , we will
change to another activity on a game way , never mention
time requiered to finish the task.
•Place sould be the same where the
participants work
•The place to evaluate the participants is the same place
where they work or study , it means don’t leave the
participants to an enviroment they don’t know, it make the
participants feel unsafe and shy. Try to make the test
sesion on a room inside the institution.
7. Run the test session
Table 8: Usatestdown: Run the test session
USATESTDOWN
Step : Run the test session
Definition This is the essential part of the evaluation because it is here that the usability evaluation is completed. (1)
Welcome; (2) Ask the participants to carry out the tasks; (3a) If performance is measured, measure the times,
(3b) If performance is not measured, interrupt the user to clarify their decisions; (4) Note the number of errors
and other objective data; (5) Distribute a satisfaction questionnaire and complete a personal interview.
Bibliograph
y Research:
BIBLIOGRAPHY SUGESTION REAL EXPERIENCE
[20] The evaluation sould be made on
the users on a one-to-one basis.
We noticed this making the test sessions
[19] Support to the participants The suport to the participants was really important because when
the participants can not perform something they have te dendence
to be passive.
Usatestdow
n
USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
•Do not complete the final test on the
same day as the pilot testing
•Because the users will be tired and confused if the first pilot
process failed.
•Record everithing the participant make
and all his body behavior
•This information is very important to make the cualitative
analysis
•Make a pause during the test •Schedule a break halfway through the test session and remind the
participants that they can stop at anytime. Take note of the times
when the participant asks for help.
•Use simple language to speak with the
participants
•Use simple words when directing the participants. When you
explain to the participants the tasks, process, objectives etc, you
should use a esy vocabulary and you must to speak
•Take note of the times when the
participant asks for help.
•The evaluator mus to take note of the times when the participant
asks for help and it will be showed on the final inform like a
parameter to take on count on the evaluation
•Speak slowly and repeat some times •Speak slowly and some times is necessary repeat the same idea
to the same participant and trying to make he or she pay attention
, the participants had a problem to concentrate.
•The participant who participated on
the pilot test can participate on the real
test
•It is recommended to execute the complete test from the
beginning, including the first participant who colaborate on the
pilot test because the particpants do not memorize easily. It
should also include the changes that were made to the test plan
after the pilot.
•Take nnot of the all participant
behaviour
•Consider the reactions of the persons being evaluated for each of
the tasks that they complete. It is very important to determine
their satisfaction level and the improvements that could be made
in the next version. We had diferents participants reactions suc
as: smile, sad,angry, worried, thinking long time, complains,
12. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
12
asks, etc. Every one means important informationn at th
emomento to evaluate.
•Apply USATESTDOWN
questionaries proposed
•In general, we can see that it was necessary to adapt the SUS
questionnaire for the persons with Down syndrome because it is
a complex survey for participants. SUS was modified to evaluate
the USATESTDOWN process, the guide, which was designed
with the expert tutors who work with the participants daily.
•Solve all of the questions that the user
has during the process,
•It is important because otherweise the participants could not
follow the next step, the answerd could be on a discrete way to
support the participant but it is necessary because they have
limitations to memoriz or understand easily. Don’t let the
participant alone.
•Apply the questionaries
USATESTDOWN propose as soon as
posible.
•After completing the usability test session with a down syndrome
participant, facilitator needs to ask the participant to answer post
task questionnaire that USATESTDOWN propose as soon as
posible because the particiants use to forgeteasily.
• Ask theparticipant if he/she wants to
colabrate
•Don’t push the persons to participate if they don’t want, it may
generate a bad atmosphere to work.
•Don’t push the participant to anser a
question
•Don’t push the persons to answer if they don’t want, it may
generate a bad atmosphere to work.
Documents -UsatestDown Demographic Questionary (Annexes)
-UsatestDown SUS Questionary adapted to persons with Down Syndrome focused in the whole process
-UsatestDown SUS Questionary to Tutors focused in the whole process (Annexes )
8. Analyse the collected information
Table 9: Usatestdown: Analyse the collected information
USATESTDOWN
Step : Analyse the collected information
Definition Analyze the objective data (times, errors, etc.), the more subjective data (satisfaction questionnaire and
interviews), and all of the data that contributes to understanding the behavior of the evaluated persons
from the usability test. The objective is to identify usability problems and propose improvements.
Bibliography
Research:
BIBLIOGRAPHY
SUGESTION
REAL EXPERIENCE
The autors J. G. Wishart
proposed the DEVAN
method[41].
We tried to apply but was too complicated and was focused only to
childrens
Usatestdown USATESTDOWN
GUIDELINE
GOT FROM EXPERIENCE
•Compare the qualitative
with quealitative dates.
•It is important to analyze the data with all of the parameters collected
from the persons who participated in the usability test. This involves
qualitative content (logs) as well as quantitative (user reactions). It
means the results could be diferent because persons with dow syndrome
have the tendo to be friendly and they will not aswer the questions on a
objective way, they would say the answer the evaluator would like to
hear. For this reason the evaluator sgould conduct an analysis of the part
that appeared qualitatively in the evaluation and the quantitative data
results
•Take specific attention
on applications data logs
to make Statistics, it will
show the real result
•The tool should help the evaluation with logs whoes alow the evaluators
analyse the participants interactions with the mobile device for exampel,
how many times the participant touch the screen, on wich way, up,
down, left, right etc. Finally we could analyse this information in a
quantitative way.
•The collected data by
observing when the
persons performing the
task scenarios sould be
here
•The results should show the collected date during the test sesion, they
are so important to analyse the cualitative part.
•The index indicators
should be clear
explained
•Index as : Success, Satisfaction and Frustration Rate per Task and
Document should be analysed it shows the most information when the
evaluator is working with people with down syndrome, they use to be so
expresive with their face or body behave. This includes; the persons
feeling, fun, ease of use and their satisfaction level towards the game.
13. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
13
9. Report results to the development team or management.
Table 10: Usatestdown: Report results to the development team or management.
USATESTDOWN
Step: Report results to the development team or management.
Definition Prepare a presentation or report to explain the usability problems that were encountered and how they can be
improved.
Bibliography
Research:
NO CONTRIBUTIONS
Usatestdown USATESTDOWN GUIDELINE GOT FROM EXPERIENCE
• All people involve in the test
sesion should be on the
presentacionand give their own
point of view and comments
•The results presentation should be done to all of the members of the
group, with a clear document
•The document to send to the
Design Develop department all the
data logs information should be
included.
•The inform to the Desig an Develop department should include all
the, and with the respective backups such us, aplication logs,
recorded videos, questioanries, etc.
•Make a short and easy to
understand inform to the Directives
people on the centre, they use to
use the information to improve the
education way
•We did a inform with the most important points found on the test
sesion because the centres use this information to improve the way
to teach, but the inform must not have participants personal
information because it must be private
•Save the participants information
on a confidential way after the test
sesion.
•Apply the Ethical Issues in Recruiting Participants, it means follow
the rules that each centre have to manage the participant
information with ethical process. We should safe in a private and
confidential way the collected information.
•Include the old reports if it there
would be from another interation
and make a comparision.
•In the case that the results were not satisfactory, improvements to
the system should be made and it should be executed again,
following the USA TESTDOWN guide.
a. USATESTDOWN GUIDE
1. Establish the tasks
•Take the participants with the same level of disability.
•The tasks should not have a high complex level. The difficult scale should be of 1 to 3,
where 1 is easier, the task should take 1.
•The session should be done in 10 minute sessions for each person,
•Do not limit to the participants the time.
2. Write the instructions
•Use only the oral way to explain the task to the participants
•Ask the participant if he/she is a willing participant.
•Speak slowly and repeat the task
•Perform the session with the participant individually.
3. Define the test plan
•The demographic survey must have only general information not lasts names.
•Apply the User satisfaction survey only with 3 answers . USATESRDOWN tets is
recommended.
•Don’t use documents with text to the participants. If you need to give documents it is
better with graphics or don’t not use documents
•Write short questions only with 3 answers
14. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
14
•Write questions focused on the applications and try to make understand the
participants how important is to say the truth
•Participation of the expert tutors is required
•The sessions will be facilitated and observed by only one facilitator to one participant
•Persons need to be encouraged to participate and facilitator should stress the value of
the child’s input and show appreciation and gratitude.
•The educators of people with DS should be present at the moment of perform the
session.
•Give the participant the device for long time to execute the game (or task) task at
home. Application should have a data log to record.
•Apply at least 2 evaluation methods
•Establish objective metrics with a completion time for the task, error rate, etc.
•The participants should have pre training about the application
•Establish subjective metrics such as success, frustration, satisfaction, etc.
•Schedule a break halfway
•Record videos about the participant sessions but without faces.
•Hold a meeting prior to executing the test
•Observation method needs facilitator to record all children action, behaviours and
facial expressions while observing children playing the game.
•The evaluator should evaluate every participant on an individual way.
•Do not use the technique of “thinking out loud”
4. Run the pilot test
•Record on video the interaction of the person with the mobile device
•Ask for parents’ permission if it is necessary to film faces,
•To the pilot test is necessary only one participant
•The tutors or professors should be present on the evaluation session.
•The facilitator will sit next to the child during the session to take note and solve
participant questions
•Two questionnaires need to be assessed, they are proposed for USATESTDOWN
•Post task questionnaire will be conducted right after each test session with the help
from the Tutor or Parent
•Take note of the times when the participant asks for help.
•Take a pause
•Use simple words when directing the participant
•Speak slowly slow and sometimes is necessary repeat the same idea
5. Refine the test plan after analysing the results of the pilot tests.
•Validate the tasks what the evaluator would you like to change with the Tutors
•Write the changes will be done and explain the reason why it was made.
•It is required a formal document signed by the participants tutor to make changes.
6. Recruit participants
•It is necessary that evaluators determine the cognitive disabilities level of the
participants that they need, only the age is not a parameter to be on count.
•There should get at least 10 participants to the evaluation
15. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
15
•Send clear information about the session objective to the Technology Department, if
they are interested on the research and they could find an importation to the centre
they would contact with the Directives explaining the advantages they could have.
•Evaluator and Tutor should have a meeting to define the participant profile and tutor
should recommend the participants profile to make the task that the evaluator
proposed.
•The facilitator should ask the participant if he/she wants to collaborate
•Don’t push them to finish fast.
•Place should be the same where the participants work
7. Run the test session
•Do not complete the final test on the same day as the pilot testing
•Record everything the participant make and all his body behaviour
•Make a pause during the test
•Use simple language to speak with the participants
•Take note of the times when the participant asks for help.
•Speak slowly and repeat some times
•The participant who participated on the pilot test can participate on the real test
•Take not of the all participant behaviour
•Apply USATESTDOWN questionaries’ proposed
•Solve all of the questions that the user has during the process,
•Apply the questionaries’ USATESTDOWN propose as soon as possible.
•Ask the participant if he/she wants to collaborate
•Don’t push the participant to answer a question
8. Analyse the collected information
•Compare the qualitative with qualitative dates.
•Take specific attention on applications data logs to make Statistics, it will show the
real result
•The collected data by observing when the persons performing the task scenarios
should be here
•The index indicators should be clear explained
9. Report results to the development team or management.
•All people involve in the test session should be on the presentation and give their own
point of view and comments
•The document to send to the Design Develop department all the data logs information
should be included.
•Make a short and easy to understand inform to the Directives people on the centre,
they use to use the information to improve the education way
•Save the participants information on a confidential way after the test session.
•Include the old reports if it there would be from another interaction and make a
comparison.
16. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
16
b. Questionaries suggested by UsatestDown
We showed the questionnaires with the following tables.
Table 11: SUS Questionnaire for persons with Down syndrome
SUS QUESTIONNAIRE YES MAYBE NO
1. Would you use this application to work?
2. Do you think the application is difficult to use?
3. Do you think the application is easy to use?
4. Do you think help is necessary in order to use the
application?
5. Do you think the application would be useful for your
work colleagues?
Open questions
1. What did you like
mostly?..........................................................................................................
2. What did you
dislike?..................................................................................................................
3. What did you find easy to do
…………………………………………………………………..
4. What did you find so diffiut to do
?.............................................................................................
Table 12: Demographic Questionnaire example
ID Name Age Do you have a
smarth cell
phone ?
Did you use
computers ? How
oft?
1
2
3
Table 13: Formulary Example to Tutor
Table 14: Examples of Metrics to measure the participant satisfaction level
User id
User
Name
Age Gender
Task
Secuence
No.
Evaluator
Do you
have a
smarth
cellphone
?
Ratio of
tasks
completed
correctly
/incorrectly
(VIDEOS)
Number of
times the
user
expresses
satisfaction
(VIDEOS
)
Number of
times the user
expresses
frustration
3 RR 28 MASCULINO 1 Doris SI
3 RC 28 MASCULINO 1 Doris SI
3 PP 28 MASCULINO 1 Doris SI
17. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
17
4. CONCLUSIONS AND FUTURE WORK
In general, we can see that it was necessary to adapt the SUS questionnaire for the persons with
Down syndrome because it is a complex survey for participants. SUS was modified to evaluate
the USATESTDOWN process, the guide, which was designed with the expert tutors who work
with the participants daily.
In general, it is clear that the guide is viable and can be successfully used and modified to the
needs of persons with Down syndrome, with this as an example of a real-world success. It was
also evaluated by the expert tutors as part of this process, which was a great help and supported
the adaptation of the guide. The participation of the expert tutors is very important as their
experience greatly contributed to the implementation of the test, following the guide.
Additionally, it is critically important to include the expert tutors with the interaction with the
participants’
It is necessary also the previous interactions with the application to create a comfortable and
familiar environment so the participants feel safe and trust the process as they are asked questions
or doing a task. We recommend that times are not as strict and participants are able to work with
as much flexibility as possible. The time parameter set by the first participant to force the second
participant to complete the task in the same amount of time was not always produce the same
cognitive or memory coefficients.
We suggest an evaluation stage where devices are given back to them to determine how much
time is necessary for them to work independently from the tutors and then independent of the
application and able to do the activity without the support of a tutor or the application.
REFERENCES
[1] J. Jadán-Guerrero, L. Guerrero, G. López, D. Cáliz, and J. Bravo, “Creating TUIs Using RFID
Sensors—A Case Study Based on the Literacy Process of Children with Down Syndrome,” Sensors,
vol. 15, no. 7, pp. 14845–14863, 2015.
[2] L. M. Normand, “No Title.”
[3] A. Brandão, E. Passos, C. Vasconcelos, A. Conci, E. Clua, P. T. Mourão, and M. Cordeiro,
“Stimulating imitation of children with Down syndrome using a game approach,” VIII Brazilian
Symp. Games Digit. Entertain., pp. 97–100, 2009.
[4] J. R. Joseph S. Dumas, A Practical Guide to Usability Testing.
[5] A. Lepistö, “Usability evaluation involving participants with cognitive disabilities,” Proc. third Nord.
Conf. Humancomputer Interact. Nord. 04, pp. 305–308, 2004.
[6] J. Nielsen and M. Kaufmann, “Usability Engineering,” p. 340, 1993.
[7] J. Nielsen, “Heuristic Evaluation,” Usability Insp. Methods, pp. 25–62, 1994.
[8] A. Brand??o, D. G. Trevisan, L. Brand??o, B. Moreira, G. Nascimento, C. N. Vasconcelos, E. Clua,
and P. T. Mour??o, “Semiotic inspection of a game for children with Down syndrome,” Proc. - 2010
Brazilian Symp. Games Digit. Entertain. SBGames 2010, no. August 2016, pp. 199–210, 2011.
[9] R. Pal, “On the Lewis-Nielsen model for thermal/electrical conductivity of composites,” Compos.
Part A Appl. Sci. Manuf., vol. 39, no. 5, pp. 718–726, 2008.
18. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
18
[10] I. Macedo and D. G. Trevisan, “A Method to Evaluate Disabled User Interaction : A Case Study with
Down Syndrome Children,” Univers. Access Human-Computer Interact. Des. Methods, Tools,
Interact. Tech. eInclusion, pp. 50–58, 2013.
[11] L. Kumin and J. Lazar, “A Usability Evaluation of Workplace-Related Tasks on a Multi-Touch Tablet
Computer by Adults with Down Syndrome,” J. Usability …, vol. 7, no. 4, pp. 118–142, 2012.
[12] R. Ramli and H. B. Zaman, “Designing usability evaluation methodology framework of Augmented
Reality basic reading courseware (AR BACA SindD) for Down Syndrome learner,” Proc. 2011 Int.
Conf. Electr. Eng. Informatics, ICEEI 2011, no. July, 2011.
[13] F. Adebesin, P. Kotzé, and H. Gelderblom, “The complementary role of two evaluation methods in
the usability and accessibility evaluation of a non-standard system,” Proc. 2010 Annu. Res. Conf.
South African Inst. Comput. Sci. Inf. Technol. - SAICSIT ’10, pp. 1–11, 2010.
[14] R. L. Yussof and H. Badioze Zaman, “Usability evaluation of multimedia courseware (MEL-SindD),”
Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics),
vol. 5857 LNCS, pp. 337–343, 2009.
[15] D. Cáliz, L. Martínez, X. Alamán, C. Terán, and R. Cáliz, “‘ U Sability Testing in Mobile
Applications Involving People With Down Syndrome : a Literature Review ,’” ICAIT 2016 Conf.,
2016.
[16] Asindown ORG, “Asindown Valencia,” 2017. [Online]. Available: http://asindown.online/.
[Accessed: 10-Jan-2017].
[17] M. Corredentora, “Ma. Corredentora,” 2017. [Online]. Available:
http://mariacorredentora.org/wpmcorg/. [Accessed: 10-Jan-2017].
[18] A. ORG, “Apadema,” 1971. [Online]. Available: http://www.apdema.org/tag/madrid/.
[19] “Fundación PRODIS,” 2016. [Online]. Available: http://www.fundacionprodis.org/. [Accessed: 14-
Jun-2016].
[20] R. L. Yussof and T. N. S. T. Paris, “Reading Activities Using the Scaffolding in MEL-SindD for
Down Syndrome Children,” Procedia - Soc. Behav. Sci., vol. 35, no. December 2011, pp. 121–128,
2012.
[21] J. Marco, E. Cerezo, and S. Baldassarri, “Bringing tabletop technology to all: Evaluating a tangible
farm game with kindergarten and special needs children,” Pers. Ubiquitous Comput., vol. 17, no. 8,
pp. 1577–1591, 2013.
[22] “Maria Corredentora Centre,” 2016. [Online]. Available: http://mariacorredentora.org/wpmcorg/ .
[Accessed: 11-Nov-2016].
19. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.7, No.2, April 2017
19
Authors
Ing. MSc. Doris Cruz Caliz Ramos.
• Computer Sciences Engineering
• Master in Management of Information Technology and Communications
National Polytechnic School Ecuador. 2008 - 2012
• International Leadership Training. Germany. 2011 - 2012
• PHD Student in Polytechnic School Madrid. 2013- 2017
• Academic Visitor in Middlesex University London. 2015 – 2016
• Academic Visitor at Bremen University Germany. 2016
• Academic Visitor Karlsruhe Institute of Technology (KIT). Pervasive
Computing Systems – TecO 2017
Doctor. Loic Antonio Martinez Normand
• Professor Department ETSIINF, DLSIIS, Madrid Polytechnic University. 2008
– Today.
• Researcher in Group Investigation on Technology Informatics and
Communications: CETTICO.
• President Sidar Foundation. 2002 – Today
Ing.MSc. Richarth Harold Caliz Ramos.
• Master in Management of Information Technology and Communications MSc,
final mark: cum laude. National Polytechnic School (EPN), Quito, Ecuador
(Fall 2008-Winter 2010)
• Telecommunications and Electronics Engineering, final mark: cum laude.
National Polytechnic School (EPN), Quito, Ecuador (Fall 1995-Winter 2002)