SlideShare a Scribd company logo
1 of 37
TURKU UNIVERSITY OF APPLIED SCIENCES
Business Information Systems (MBA)
Master's Thesis Presentation
May 2014
By
Youssef Hammouche
 The rapid changes of information technology,
present a new challenge and awareness of the
necessity to adopt new tools and processes to
improve the quality of education system.
 In confronting this challenge it became obligatory
to know the complexity of the education system
from student’s perspective and related problems
that should be addressed.
 every education system must have an
independent strategy of changes to determine the
affecting factors of failure or success in education
system.
 The usability testing represent one of the success
factors to be implemented into any LMS to
evaluate the examined interfaces by testing it on
users.
 It became an essential component of LMS
development process similar to software testing
and system design.
 LMS might be very difficult to use by students if
usability problems are not identified in early stage
 Many LMS projects have failed during last few years
to stay among the top existing systems, reasons could
be numerous but lack of usability testing is
considered as one of the most common reasons.
 especially that students interactions with system is
highly impacted with various barriers: lack of available
support by teachers, poorly motivated to understand
system's features, students are unsure in the use of
ICT.
 Therefore it is mandatory to conduct usability testing
during the system development cycle.
CONTENT
LIST OF ABBREVIATIONS (OR) SYMBOLS
1. INTRODUCTION
1.1. Problem Statement and Research Objectives
1.2. Research Methodology
1.3. Optima LMS
2. LEARNING MANAGEMENT SYSTEMS
LMSs 2.1. Open Source LMS
2.2. CLOUD LMS
2.3. Steps in Selecting a LMS
2.4. Key Factors of Successful LMS
3. THE USABILITY TESTING PLAN OF
OPTIMA LMS
3.1. The Concept of Usability Testing
3.1.1. What is Usability?
3.1.2. What is Usability Testing
3.1.3. The Purpose of Usability Testing
3.1.4. What to Test?
3.2. Usability Test Plan for Optima LMS
3.2.1. Problem Statement and Test Objectives
3.2.2. User Profile 3.2.3.
Methodology
3.2.3.1. Participants
3.2.3.2. Length of Sessions 3.2.3.3.
Quantitative & Qualitative Data 3.2.4. Scenarios and
Tasks
3.2.5. Test environment and Equipment
4. EMPIRICAL USABILITY TESTING IN
OPTIMA LMS
4.1. Data Collection
4.2. Test Results and Analysis
4.2.1. Top Negative Finding
4.2.1.1. Website Layout and Login Process
4.2.1.2. System Features and Editing Options
4.2.2. Top Positive Finding
4.2.3. Findings Log from the Observer
4.2.3.1. Task Completion Rate
4.2.3.2. Time on Task
4.2.3.3. Problems and Helps required
4.2.4. Presenting Results Based on Post-task and Post-test
Questionnaires
5. USABILITY RECOMMENDATIONS FOR
OPTIMA LMS DEVELOPERS
6. DISCUSSION
REFERENCES
APPENDICES
Appendix 1. Pre-test Questionnaire.
Appendix 2. Post-task Questionnaire.
Appendix 3. Post-test Questionnaire. Appendix 4.
Usability Testing Video Permission Form
 Discendum is the optima system developer; they
consider it as a high-quality system with an easy tool to
be used by users to build a perfect online environment.
 Optima service aimed to become one of the best existing
platforms for eLearning courses, information
management, networking, and supporting learning on
the job.
 Actually, more than 200 educational institutions and
companies have implemented Optima to support their
education and projects.
 Actually, more than 200 educational institutions and
companies have implemented Optima to support their
education and projects.
 Based on the cited quality of Optima and growing
interest of customers, the system is not yet classified
among the top learning management systems.
 Only a few academic literatures have been written under
the name of Optima.
 often those documents belong to libraries of universities
which kept a right for only their users to access into it.
 This limitation makes the case more complicated
and stands as a barrier of sharing Optima
researches to external readers of Finnish
universities
 Additionally, lack of usability testing researches
has been conducted on the subject, which
makes my research a bit difficult to collect
necessary information and to reach my study
goals.
 On the other hand, similar learning management
system has taken a wide attention across the
world, despite that Optima has improved all
interfaces by merging versatile tools, flexible
online environment, and high security access
"Moodle serve over 70 million users“
 Do Optima system provide enough functionality to
users to help them achieve their study goals?
 Is the slow success of Optima due to the usability
of system which would reflect the users’
satisfaction and dissatisfaction to the system?
 Is Optima system afford enough information and
help to users with less effort and less clicks of
navigation?
 Is Optima Easy –to- use?
 In order to get responses to the previous questions, a
usability testing should be taken into consideration to
find out how real users use the system in real life, and
which kind of difficulties and problems users might
encounter during their daily tasks?
 This thesis concentrates onto students interface only,
to design a test plan based on the literature of Carol
M. Barnum (Usability Testing Essentials Ready, Set…
Test), and Joseph S. Dumas (A Practical Guide to
Usability Testing), and other resources as well.
Constructive research, it is considered as one of the
options currently available for a case researcher, and it
has been widely developed in the field of business
administration and IS.
It has gained significant results by implementing new
construction to solve problems faced in real world, and
this involves the analysis of the users and performance of
the system design in order to understand, explain, and
improve the designed systems.
 This research method matched much on my study
research, where I am supposed to understand
Optima system environment, and try to find
usability problems encountered by users.
 The new construction issue in this research is to
design a test plan based on theoretical part
which frequently includes a test objectives,
methods, and scenarios.
 The practical part is reserved to apply the test
plan and to collect data based on the selected
methods, for a goal to be analysed, interpreted,
and presented in form of recommendations to
project stakeholders.
 Optima is a web-based learning platform that
supports learning environment and delivers
extensive training programs, managing sales
trainings, and offers opportunities to utilize
different learning models and pedagogical ideas.
 Optima is a Finnish company developed by
Discendum together with its customers, company
was established in 2001 for a goal to create and
implement online learning managements and
related training consultation services.
 Company has delivered over 200 online learning
solutions to various sorts of customers such as
institution of higher education, companies, and
other organizations.
 The Company turnover of the fiscal year 2011 was
approximately 1, 6 million euros; currently
company employ 18 people in cities of Helsinki,
Tampere, Rauma, and Oulu. Optima headquarters
are located in Oulu.
What is Usability?
ISO 9241: "The extent to which a product
can be used by specified users to achieve
specified goals with effectiveness,
efficiency, and satisfaction in a specified
context of use.” still wider:
Specified users: it concerns the persons to
whom the product is designed for.
Specified goals: Are the shared goals between
the users and product.
 A specified context of use: Is the
environment where the product should work by
the users.
 EX:“website, tools, mobile devices, software
application, or anything designed for people.
 Whitney Quesenbery' has given an easy
definition to remember, called 5Es:
 Effective:" How the user could complete the task
and reach the goals?"
 Efficient: "How fast the task can be done?"
 Engaging: "Is the interaction between users and
designed interface, and how satisfied are they
about it?“
 Error tolerant: "How many errors committed by
users? How easily do users can recover from it?"
 Easy to learn: "How easy could the user
accomplish the basic tasks for the first time they
encounter a new product or service?" (Whitney
Quesenbery. February 2004.)
 What is Usability Testing?
 Represents all activities that focuses on observing
users testing a product or service in certain
working conditions,
 the observer is supposed to watch, listen and take
notes while the participants are trying to complete
tasks
 for a goal to identify usability problems, collect
qualitative and quantitative data, and to determine
participants satisfaction and dissatisfaction with
the product or service. Generally the usability
testing has two forms:
 Formative testing: while the product is still in
the development process, for a goal to diagnose
the problems and try to fix them before
represented to the consumers.
 Summative testing: commonly when the
product is finished, with a goal to validate if the
product meets the consumers requirements.
(www.usability.gov).
The Purpose of Usability Testing
UT became a necessary condition for a Website to
survive.
Web visitors are not trying seriously to spend much
effort to understand what the Web offers for them
as information or service, they leave the website as
soon as they find difficulties to use it or to figure out
what the web interface is trying to present for them.
But the case might be totally different if you are
forced to use a website or system which you are not
familiar with and it has not been well tested.
 therefore the usability testing should be adopted
for any system to support users and to identify
problems based on their experiences.
 Reasons to test optima LMS:
 the number of conducted UT into Moodle CMS is
incomparable with any other LMS
 although Optima has almost the same features as
Moodle
 it has been used during a long period by our
school educators and students
 it has gained a wide success by the users due to
the free of charge of using the system by the open
universities, university staff, and for the academic
research purposes as well.
 Other reason is to find out how students could
easily use Optima platform for e-learning courses,
support learning tools, information management,
and as a space for interaction and collaboration
between students and supervisors.
What to Test?
Due to many reasons I have selected student as an
interface to be tested during this usability testing to
understand their experiences with the system and to
determine whether the usability of it matches their
expectations and support their goals.
Students are confronting more usability problems
and difficulties compared to other users.
 Easy to include students in testing process than
supervisors.
 number of students that are using Optima system
are extremely higher compared to other interface
users.
 The common statement in usability testing is to
inform the participants that "We are testing
the product, not you".
 Will document all the essential test planning steps
and methods that will be used by me, to verify and
ensure that Optima system meets the requirement
of testing objectives.
 will be presented as a formal report to record all
the important activities related to the tested
interface,
 to figure out how the system would be tested, and
to know the persons who will be recruited for this
testing. The final report will be as a part of my final
thesis work
 The test plan will include the sections below:
Title page, Table of Contents,
List of Illustration, Abbreviation & Figures
Executive Summary, Problem Statement and Test
Objectives, Methodology, User Profiles
Participant Incentive, Screeners, Scenarios &
Tasks, Evaluation Methods, Test environment &
Equipment, Presentation of Findings,
Pre-test Questionnaire, Post-task & Post-test
Questionnaire, Recommendations, & Appendices
 is to discover whether Optima system is easy to
be used and learned from students interface,
 to find out if they could perform proposed tasks
within a pre-determined time frame and how
well they could understand it,
 to ensures if the system design works as intended
and meets users expectations.
 To find serious usability problems which are
related to system navigation, work functionality,
message errors and system features.
 Finally is to explore if Optima LMS is effective
and efficient as it should be, by knowing how
users can find information they need to complete
tasks without help.
 Of course I didn’t test every possible task that
user could do with the system due to many
constraints such as nature of research, limitation
of human and monetary resources.
 For this matter we created Scenarios and tasks to
help us determine what we want to learn by
observing six participants whom matched the
testing profile to achieve tasks in the Work
Informatics User Experience WIUX
Laboratory in Turku ICT building.
 Four kind of scenarios in total were planned for
this testing, each one contained three tasks to be
accomplished in a predetermined time frame,
 each time participant was done with scenario he
or she was given the post-task questionnaire and
then the next scenario,
 Tasks for testing Optima LMS are in this link
https://optima.turkuamk.fi and it included:
 Website layout: How easily can users understand
the website layout?
 Optima Login process
 Access to the desired degree program.
 Finding Information & help gained from the Help
icon.
 Navigation, Satisfaction & Dissatisfaction
 Advanced Options: number of object,
Cloud services…etc.
Master thesis presentation

More Related Content

What's hot

Two-Scheme Grading Management and Student Profiling System
Two-Scheme Grading Management and Student Profiling SystemTwo-Scheme Grading Management and Student Profiling System
Two-Scheme Grading Management and Student Profiling SystemRix Morales
 
Using Ontology in Electronic Evaluation for Personalization of eLearning Systems
Using Ontology in Electronic Evaluation for Personalization of eLearning SystemsUsing Ontology in Electronic Evaluation for Personalization of eLearning Systems
Using Ontology in Electronic Evaluation for Personalization of eLearning Systemsinfopapers
 
Kelly saleh howey_proposal
Kelly saleh howey_proposalKelly saleh howey_proposal
Kelly saleh howey_proposalPatrick Howey
 
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...University Website Quality Ranking using Logarithmic Fuzzy Preference Program...
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...IJECEIAES
 
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...ijseajournal
 
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATION
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATIONA GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATION
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATIONijma
 
IRJET- Institution Evaluation System
IRJET- Institution Evaluation SystemIRJET- Institution Evaluation System
IRJET- Institution Evaluation SystemIRJET Journal
 
Issues and challenges with assessment in stand alone moodle
Issues and challenges with assessment in stand alone moodleIssues and challenges with assessment in stand alone moodle
Issues and challenges with assessment in stand alone moodleHelen Farley
 
A study of the interface usability issues of mobile learning applications for...
A study of the interface usability issues of mobile learning applications for...A study of the interface usability issues of mobile learning applications for...
A study of the interface usability issues of mobile learning applications for...IJITE
 
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...IJITE
 
The State of UC: Future Adopters Poised to Reap Benefits via Cloud
The State of UC:  Future Adopters Poised to Reap Benefits via CloudThe State of UC:  Future Adopters Poised to Reap Benefits via Cloud
The State of UC: Future Adopters Poised to Reap Benefits via CloudMari Hansen
 
Load balancing clustering on moodle LMS to overcome performance issue of e-le...
Load balancing clustering on moodle LMS to overcome performance issue of e-le...Load balancing clustering on moodle LMS to overcome performance issue of e-le...
Load balancing clustering on moodle LMS to overcome performance issue of e-le...TELKOMNIKA JOURNAL
 
Pact Analysis Report for a Student Attendance System
Pact Analysis Report for a Student Attendance SystemPact Analysis Report for a Student Attendance System
Pact Analysis Report for a Student Attendance SystemUpekha Vandebona
 

What's hot (18)

Two-Scheme Grading Management and Student Profiling System
Two-Scheme Grading Management and Student Profiling SystemTwo-Scheme Grading Management and Student Profiling System
Two-Scheme Grading Management and Student Profiling System
 
Using Ontology in Electronic Evaluation for Personalization of eLearning Systems
Using Ontology in Electronic Evaluation for Personalization of eLearning SystemsUsing Ontology in Electronic Evaluation for Personalization of eLearning Systems
Using Ontology in Electronic Evaluation for Personalization of eLearning Systems
 
Kelly saleh howey_proposal
Kelly saleh howey_proposalKelly saleh howey_proposal
Kelly saleh howey_proposal
 
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...University Website Quality Ranking using Logarithmic Fuzzy Preference Program...
University Website Quality Ranking using Logarithmic Fuzzy Preference Program...
 
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...
SOCIO-DEMOGRAPHIC DIFFERENCES IN THE PERCEPTIONS OF LEARNING MANAGEMENT SYSTE...
 
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATION
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATIONA GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATION
A GUIDELINE FOR AN EFFECTIVE USER INTERFACE FOR EDUCATIONAL SEMANTIC APPLICATION
 
IRJET- Institution Evaluation System
IRJET- Institution Evaluation SystemIRJET- Institution Evaluation System
IRJET- Institution Evaluation System
 
Issues and challenges with assessment in stand alone moodle
Issues and challenges with assessment in stand alone moodleIssues and challenges with assessment in stand alone moodle
Issues and challenges with assessment in stand alone moodle
 
A study of the interface usability issues of mobile learning applications for...
A study of the interface usability issues of mobile learning applications for...A study of the interface usability issues of mobile learning applications for...
A study of the interface usability issues of mobile learning applications for...
 
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...
A STUDY OF THE INTERFACE USABILITY ISSUES OF MOBILE LEARNING APPLICATIONS FOR...
 
Ilp modeling with excel
Ilp modeling with excelIlp modeling with excel
Ilp modeling with excel
 
Oco usability
Oco usabilityOco usability
Oco usability
 
The State of UC: Future Adopters Poised to Reap Benefits via Cloud
The State of UC:  Future Adopters Poised to Reap Benefits via CloudThe State of UC:  Future Adopters Poised to Reap Benefits via Cloud
The State of UC: Future Adopters Poised to Reap Benefits via Cloud
 
Users Acceptance of Online Enrollment Processes
Users Acceptance of Online Enrollment ProcessesUsers Acceptance of Online Enrollment Processes
Users Acceptance of Online Enrollment Processes
 
Ijetr021224
Ijetr021224Ijetr021224
Ijetr021224
 
Load balancing clustering on moodle LMS to overcome performance issue of e-le...
Load balancing clustering on moodle LMS to overcome performance issue of e-le...Load balancing clustering on moodle LMS to overcome performance issue of e-le...
Load balancing clustering on moodle LMS to overcome performance issue of e-le...
 
Measurement of Web Usability: An Approach
Measurement of Web Usability: An ApproachMeasurement of Web Usability: An Approach
Measurement of Web Usability: An Approach
 
Pact Analysis Report for a Student Attendance System
Pact Analysis Report for a Student Attendance SystemPact Analysis Report for a Student Attendance System
Pact Analysis Report for a Student Attendance System
 

Viewers also liked

PressInfo.pl_Prezentacja_Raporty Medyczne
PressInfo.pl_Prezentacja_Raporty MedycznePressInfo.pl_Prezentacja_Raporty Medyczne
PressInfo.pl_Prezentacja_Raporty MedyczneGM_TAI
 
Senior Thesis Presentation Format
Senior Thesis Presentation FormatSenior Thesis Presentation Format
Senior Thesis Presentation FormatKojo Ahiakpa
 
Práctica de los indefinidos (nivel avanzado)
Práctica de los indefinidos (nivel avanzado)Práctica de los indefinidos (nivel avanzado)
Práctica de los indefinidos (nivel avanzado)macorona90
 

Viewers also liked (7)

Mib
MibMib
Mib
 
Gaza docket
Gaza docketGaza docket
Gaza docket
 
PressInfo.pl_Prezentacja_Raporty Medyczne
PressInfo.pl_Prezentacja_Raporty MedycznePressInfo.pl_Prezentacja_Raporty Medyczne
PressInfo.pl_Prezentacja_Raporty Medyczne
 
Master thesis presentation
Master thesis presentationMaster thesis presentation
Master thesis presentation
 
Senior Thesis Presentation Format
Senior Thesis Presentation FormatSenior Thesis Presentation Format
Senior Thesis Presentation Format
 
Dumi
DumiDumi
Dumi
 
Práctica de los indefinidos (nivel avanzado)
Práctica de los indefinidos (nivel avanzado)Práctica de los indefinidos (nivel avanzado)
Práctica de los indefinidos (nivel avanzado)
 

Similar to Master thesis presentation

Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupNormanMendoza
 
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Waqas Tariq
 
ICFAI IT and Systems - Solved assignments and case study help
ICFAI IT and Systems  - Solved assignments and case study helpICFAI IT and Systems  - Solved assignments and case study help
ICFAI IT and Systems - Solved assignments and case study helpsmumbahelp
 
Usability in product development
Usability in product developmentUsability in product development
Usability in product developmentRavi Shyam
 
Student Assestment Questionnaire
Student Assestment QuestionnaireStudent Assestment Questionnaire
Student Assestment QuestionnaireMichael Mendoza
 
Accessibility, Usability and User Centred Design (Usabiltiy)
Accessibility, Usability and User Centred Design (Usabiltiy)Accessibility, Usability and User Centred Design (Usabiltiy)
Accessibility, Usability and User Centred Design (Usabiltiy)David Lamas
 
THE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCETHE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCEvivatechijri
 
Majestic MRSS Usability Engineering
Majestic MRSS Usability EngineeringMajestic MRSS Usability Engineering
Majestic MRSS Usability EngineeringMajestic MRSS
 
Course management system for philippine college of science
Course management system for philippine college of scienceCourse management system for philippine college of science
Course management system for philippine college of scienceFerdinand Rabina
 
MMRSS Usability Engineering
MMRSS Usability EngineeringMMRSS Usability Engineering
MMRSS Usability EngineeringMajesticMRSS
 
The Benefits Of Learning Management Systems.pdf
The Benefits Of Learning Management Systems.pdfThe Benefits Of Learning Management Systems.pdf
The Benefits Of Learning Management Systems.pdfAFI Digital
 
Implementing virual classrooms
Implementing virual classroomsImplementing virual classrooms
Implementing virual classroomsOliver Buček
 
Computer based online written test system "Tao Software"
Computer based online written test system "Tao Software"Computer based online written test system "Tao Software"
Computer based online written test system "Tao Software"Awais Chaudhary
 
CALIFYN- LEARNING MANAGEMENT SYSTEM
CALIFYN- LEARNING MANAGEMENT SYSTEMCALIFYN- LEARNING MANAGEMENT SYSTEM
CALIFYN- LEARNING MANAGEMENT SYSTEMIRJET Journal
 
Usability Primer
Usability  PrimerUsability  Primer
Usability PrimerRavi Shyam
 

Similar to Master thesis presentation (20)

Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
 
Ijetr021224
Ijetr021224Ijetr021224
Ijetr021224
 
ICFAI IT and Systems - Solved assignments and case study help
ICFAI IT and Systems  - Solved assignments and case study helpICFAI IT and Systems  - Solved assignments and case study help
ICFAI IT and Systems - Solved assignments and case study help
 
Usability in product development
Usability in product developmentUsability in product development
Usability in product development
 
Student Assestment Questionnaire
Student Assestment QuestionnaireStudent Assestment Questionnaire
Student Assestment Questionnaire
 
Accessibility, Usability and User Centred Design (Usabiltiy)
Accessibility, Usability and User Centred Design (Usabiltiy)Accessibility, Usability and User Centred Design (Usabiltiy)
Accessibility, Usability and User Centred Design (Usabiltiy)
 
195
195195
195
 
Why Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing StrategyWhy Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing Strategy
 
THE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCETHE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCE
 
Majestic MRSS Usability Engineering
Majestic MRSS Usability EngineeringMajestic MRSS Usability Engineering
Majestic MRSS Usability Engineering
 
Course management system for philippine college of science
Course management system for philippine college of scienceCourse management system for philippine college of science
Course management system for philippine college of science
 
MMRSS Usability Engineering
MMRSS Usability EngineeringMMRSS Usability Engineering
MMRSS Usability Engineering
 
The Benefits Of Learning Management Systems.pdf
The Benefits Of Learning Management Systems.pdfThe Benefits Of Learning Management Systems.pdf
The Benefits Of Learning Management Systems.pdf
 
Implementing virual classrooms
Implementing virual classroomsImplementing virual classrooms
Implementing virual classrooms
 
Computer based online written test system "Tao Software"
Computer based online written test system "Tao Software"Computer based online written test system "Tao Software"
Computer based online written test system "Tao Software"
 
Report
ReportReport
Report
 
CALIFYN- LEARNING MANAGEMENT SYSTEM
CALIFYN- LEARNING MANAGEMENT SYSTEMCALIFYN- LEARNING MANAGEMENT SYSTEM
CALIFYN- LEARNING MANAGEMENT SYSTEM
 
Project sample
Project sampleProject sample
Project sample
 
Usability Primer
Usability  PrimerUsability  Primer
Usability Primer
 

Recently uploaded

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 

Recently uploaded (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 

Master thesis presentation

  • 1. TURKU UNIVERSITY OF APPLIED SCIENCES Business Information Systems (MBA) Master's Thesis Presentation May 2014 By Youssef Hammouche
  • 2.
  • 3.  The rapid changes of information technology, present a new challenge and awareness of the necessity to adopt new tools and processes to improve the quality of education system.  In confronting this challenge it became obligatory to know the complexity of the education system from student’s perspective and related problems that should be addressed.  every education system must have an independent strategy of changes to determine the affecting factors of failure or success in education system.
  • 4.  The usability testing represent one of the success factors to be implemented into any LMS to evaluate the examined interfaces by testing it on users.  It became an essential component of LMS development process similar to software testing and system design.  LMS might be very difficult to use by students if usability problems are not identified in early stage
  • 5.  Many LMS projects have failed during last few years to stay among the top existing systems, reasons could be numerous but lack of usability testing is considered as one of the most common reasons.  especially that students interactions with system is highly impacted with various barriers: lack of available support by teachers, poorly motivated to understand system's features, students are unsure in the use of ICT.  Therefore it is mandatory to conduct usability testing during the system development cycle.
  • 6. CONTENT LIST OF ABBREVIATIONS (OR) SYMBOLS 1. INTRODUCTION 1.1. Problem Statement and Research Objectives 1.2. Research Methodology 1.3. Optima LMS 2. LEARNING MANAGEMENT SYSTEMS LMSs 2.1. Open Source LMS 2.2. CLOUD LMS 2.3. Steps in Selecting a LMS 2.4. Key Factors of Successful LMS
  • 7. 3. THE USABILITY TESTING PLAN OF OPTIMA LMS 3.1. The Concept of Usability Testing 3.1.1. What is Usability? 3.1.2. What is Usability Testing 3.1.3. The Purpose of Usability Testing 3.1.4. What to Test? 3.2. Usability Test Plan for Optima LMS 3.2.1. Problem Statement and Test Objectives 3.2.2. User Profile 3.2.3. Methodology 3.2.3.1. Participants 3.2.3.2. Length of Sessions 3.2.3.3. Quantitative & Qualitative Data 3.2.4. Scenarios and Tasks 3.2.5. Test environment and Equipment
  • 8. 4. EMPIRICAL USABILITY TESTING IN OPTIMA LMS 4.1. Data Collection 4.2. Test Results and Analysis 4.2.1. Top Negative Finding 4.2.1.1. Website Layout and Login Process 4.2.1.2. System Features and Editing Options 4.2.2. Top Positive Finding 4.2.3. Findings Log from the Observer 4.2.3.1. Task Completion Rate 4.2.3.2. Time on Task 4.2.3.3. Problems and Helps required 4.2.4. Presenting Results Based on Post-task and Post-test Questionnaires
  • 9. 5. USABILITY RECOMMENDATIONS FOR OPTIMA LMS DEVELOPERS 6. DISCUSSION REFERENCES APPENDICES Appendix 1. Pre-test Questionnaire. Appendix 2. Post-task Questionnaire. Appendix 3. Post-test Questionnaire. Appendix 4. Usability Testing Video Permission Form
  • 10.  Discendum is the optima system developer; they consider it as a high-quality system with an easy tool to be used by users to build a perfect online environment.  Optima service aimed to become one of the best existing platforms for eLearning courses, information management, networking, and supporting learning on the job.  Actually, more than 200 educational institutions and companies have implemented Optima to support their education and projects.
  • 11.  Actually, more than 200 educational institutions and companies have implemented Optima to support their education and projects.  Based on the cited quality of Optima and growing interest of customers, the system is not yet classified among the top learning management systems.  Only a few academic literatures have been written under the name of Optima.  often those documents belong to libraries of universities which kept a right for only their users to access into it.
  • 12.  This limitation makes the case more complicated and stands as a barrier of sharing Optima researches to external readers of Finnish universities  Additionally, lack of usability testing researches has been conducted on the subject, which makes my research a bit difficult to collect necessary information and to reach my study goals.
  • 13.  On the other hand, similar learning management system has taken a wide attention across the world, despite that Optima has improved all interfaces by merging versatile tools, flexible online environment, and high security access "Moodle serve over 70 million users“
  • 14.  Do Optima system provide enough functionality to users to help them achieve their study goals?  Is the slow success of Optima due to the usability of system which would reflect the users’ satisfaction and dissatisfaction to the system?  Is Optima system afford enough information and help to users with less effort and less clicks of navigation?  Is Optima Easy –to- use?
  • 15.  In order to get responses to the previous questions, a usability testing should be taken into consideration to find out how real users use the system in real life, and which kind of difficulties and problems users might encounter during their daily tasks?  This thesis concentrates onto students interface only, to design a test plan based on the literature of Carol M. Barnum (Usability Testing Essentials Ready, Set… Test), and Joseph S. Dumas (A Practical Guide to Usability Testing), and other resources as well.
  • 16. Constructive research, it is considered as one of the options currently available for a case researcher, and it has been widely developed in the field of business administration and IS. It has gained significant results by implementing new construction to solve problems faced in real world, and this involves the analysis of the users and performance of the system design in order to understand, explain, and improve the designed systems.
  • 17.  This research method matched much on my study research, where I am supposed to understand Optima system environment, and try to find usability problems encountered by users.  The new construction issue in this research is to design a test plan based on theoretical part which frequently includes a test objectives, methods, and scenarios.  The practical part is reserved to apply the test plan and to collect data based on the selected methods, for a goal to be analysed, interpreted, and presented in form of recommendations to project stakeholders.
  • 18.
  • 19.  Optima is a web-based learning platform that supports learning environment and delivers extensive training programs, managing sales trainings, and offers opportunities to utilize different learning models and pedagogical ideas.  Optima is a Finnish company developed by Discendum together with its customers, company was established in 2001 for a goal to create and implement online learning managements and related training consultation services.
  • 20.  Company has delivered over 200 online learning solutions to various sorts of customers such as institution of higher education, companies, and other organizations.  The Company turnover of the fiscal year 2011 was approximately 1, 6 million euros; currently company employ 18 people in cities of Helsinki, Tampere, Rauma, and Oulu. Optima headquarters are located in Oulu.
  • 21. What is Usability? ISO 9241: "The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.” still wider: Specified users: it concerns the persons to whom the product is designed for. Specified goals: Are the shared goals between the users and product.
  • 22.  A specified context of use: Is the environment where the product should work by the users.  EX:“website, tools, mobile devices, software application, or anything designed for people.  Whitney Quesenbery' has given an easy definition to remember, called 5Es:  Effective:" How the user could complete the task and reach the goals?"  Efficient: "How fast the task can be done?"
  • 23.  Engaging: "Is the interaction between users and designed interface, and how satisfied are they about it?“  Error tolerant: "How many errors committed by users? How easily do users can recover from it?"  Easy to learn: "How easy could the user accomplish the basic tasks for the first time they encounter a new product or service?" (Whitney Quesenbery. February 2004.)
  • 24.  What is Usability Testing?  Represents all activities that focuses on observing users testing a product or service in certain working conditions,  the observer is supposed to watch, listen and take notes while the participants are trying to complete tasks  for a goal to identify usability problems, collect qualitative and quantitative data, and to determine participants satisfaction and dissatisfaction with the product or service. Generally the usability testing has two forms:
  • 25.  Formative testing: while the product is still in the development process, for a goal to diagnose the problems and try to fix them before represented to the consumers.  Summative testing: commonly when the product is finished, with a goal to validate if the product meets the consumers requirements. (www.usability.gov).
  • 26. The Purpose of Usability Testing UT became a necessary condition for a Website to survive. Web visitors are not trying seriously to spend much effort to understand what the Web offers for them as information or service, they leave the website as soon as they find difficulties to use it or to figure out what the web interface is trying to present for them. But the case might be totally different if you are forced to use a website or system which you are not familiar with and it has not been well tested.
  • 27.  therefore the usability testing should be adopted for any system to support users and to identify problems based on their experiences.  Reasons to test optima LMS:  the number of conducted UT into Moodle CMS is incomparable with any other LMS  although Optima has almost the same features as Moodle  it has been used during a long period by our school educators and students
  • 28.  it has gained a wide success by the users due to the free of charge of using the system by the open universities, university staff, and for the academic research purposes as well.  Other reason is to find out how students could easily use Optima platform for e-learning courses, support learning tools, information management, and as a space for interaction and collaboration between students and supervisors.
  • 29. What to Test? Due to many reasons I have selected student as an interface to be tested during this usability testing to understand their experiences with the system and to determine whether the usability of it matches their expectations and support their goals. Students are confronting more usability problems and difficulties compared to other users.
  • 30.  Easy to include students in testing process than supervisors.  number of students that are using Optima system are extremely higher compared to other interface users.  The common statement in usability testing is to inform the participants that "We are testing the product, not you".
  • 31.  Will document all the essential test planning steps and methods that will be used by me, to verify and ensure that Optima system meets the requirement of testing objectives.  will be presented as a formal report to record all the important activities related to the tested interface,  to figure out how the system would be tested, and to know the persons who will be recruited for this testing. The final report will be as a part of my final thesis work
  • 32.  The test plan will include the sections below: Title page, Table of Contents, List of Illustration, Abbreviation & Figures Executive Summary, Problem Statement and Test Objectives, Methodology, User Profiles Participant Incentive, Screeners, Scenarios & Tasks, Evaluation Methods, Test environment & Equipment, Presentation of Findings, Pre-test Questionnaire, Post-task & Post-test Questionnaire, Recommendations, & Appendices
  • 33.  is to discover whether Optima system is easy to be used and learned from students interface,  to find out if they could perform proposed tasks within a pre-determined time frame and how well they could understand it,  to ensures if the system design works as intended and meets users expectations.
  • 34.  To find serious usability problems which are related to system navigation, work functionality, message errors and system features.  Finally is to explore if Optima LMS is effective and efficient as it should be, by knowing how users can find information they need to complete tasks without help.  Of course I didn’t test every possible task that user could do with the system due to many constraints such as nature of research, limitation of human and monetary resources.
  • 35.  For this matter we created Scenarios and tasks to help us determine what we want to learn by observing six participants whom matched the testing profile to achieve tasks in the Work Informatics User Experience WIUX Laboratory in Turku ICT building.  Four kind of scenarios in total were planned for this testing, each one contained three tasks to be accomplished in a predetermined time frame,  each time participant was done with scenario he or she was given the post-task questionnaire and then the next scenario,
  • 36.  Tasks for testing Optima LMS are in this link https://optima.turkuamk.fi and it included:  Website layout: How easily can users understand the website layout?  Optima Login process  Access to the desired degree program.  Finding Information & help gained from the Help icon.  Navigation, Satisfaction & Dissatisfaction  Advanced Options: number of object, Cloud services…etc.