1
Bandar Alturki,
University of Brighton, UK
An Evaluation on Usability
of King Saud University’s
VLE from Teachers’ Perspective
Supervision Team
1.Dr. Lyn Pemberton
2.Mr. Mithileysh Sathiyanarayanan
2
A virtual learning environment (VLE) is a tool 
used within educational institutions to allow
Content management – creation, storage, access to 
and use of learning resources
Curriculum mapping and planning – lesson 
planning and assessment
Communication – emails and notices
Virtual Learning Environment (VLE)
3
VLEs – the teacher view




One-stop shop for different
media, interactivity and
communication
Q&A 
 

 






4
VLEs – the teacher view





 
Managing
learning
Designing
learning
Producing
learning



 Q&A





 
5
Aim of the Study
The  main  aim  of  the  study  is  to  evaluate  the 
effectiveness  of  King  Saud  University's  Virtual 
Learning  Environment  (VLE)  from  teachers' 
perspective. 
6
Objectives of the Study
•Investigate the reasons for teachers not using the
King Saud University blackboard (VLE) for
uploading the study materials to the students?
•Investigate the critical factors for a VLE to be
successful in teaching and learning.
•Investigate the usability problems facing the use of
the VLE in King Saud University.
•Provide optimal solutions for the usability problems.
7
•To understand the background of Saudi Culture and
their education.
•To investigate on the usability issues affecting teachers
for not using VLE.
•To examine various empirical studies (usability) carried
out with respect to VLE.
•To investigate the questionnaire models that suits the
study.
•To design the questions and plan the empirical study, to
collect the results.
•The analysis of the results to be carried and certain
guidelines/suggestions/recommendations to be proposed.
Tasks for the Study
8
Study Model
Figure: My Study Model
9
Step 1: Login to the system, provide your user id and
password.
Step 2: Select one of the course that you teach.
Step 3: Upload a relevant study material in the course
folder.
Step 4: Post one message asking the students to access
the document you recently uploaded.
Step 5: Please answer the questions in section 1 and
rate the questions in section 2.
Step 6: Please provide your feedback in the "feedback
form".
Usability Tasks
10
1. I think that I would like to use this system frequently
2. I found the system unnecessarily complex
3. I thought the system was easy to use
4. I think that I would need the support of a technical person to
be able to use this system
5. I found the various functions in this system were well
integrated
6. I thought there was too much inconsistency in this system
7. I would imagine that most people would learn to use this
system very quickly
8. I found the system very cumbersome to use
9. I felt very confident using the system
10. I needed to learn a lot of things before I could get going
SUS Questions
11
Participants total score from the 10 questions
Results - Participants Total Score
12
Results - Average Points for Each
Question
Average points of each question from the 22 participants.
13
Further Results
Further results are illustrated in the thesis.
14
•Participants were interested in using Virtual Learning
Environment (VLE) in their day-to-day life.
•Participants thought VLE was easy to use
•Participants felt there were a quite a good features in
VLE and they were well integrated.
•Participants feel most people would learn to use VLE
quickly
•Participants felt confident using VLE.
Positives from the Study
15
Negatives from the Study
•Participants felt the VLE was unnecessarily complex.
•Participants felt they need support of a technical person
to assist them when they use VLE or a proper training.
•Participants felt there was lot of inconsistency in the
VLE layout.
•Participants felt the VLE was cumbersome/awkward.
•Finally, they feel they need to learn and get hands on
experience before they get going with VLE.
16
Teachers’ concerns – from Feedback
• VLE threaten
• Access
» Accessibility
» Usability
» Bandwidth
• Communication
» Lack of non-verbal actions
» No email contact
• Expectations low and high
» Multimedia not a priority
» Demands for flexibility
» Inconsistencies in the
system
» Difficulties accessing
material
• Reliability
17
https://drive.google.com/open?id=0B6su
WOQKRkzXfncyVkZiallSaFc4YlVSZ1ktYnVvQlZ1
VndXbTlibkNvUTlzRGJQbXRaZXM&authuser=0
Raw Data from the study
18
QUESTIONS ???

Usability Evaluation of King Saud University VLE - Student Presentation

  • 1.
    1 Bandar Alturki, University ofBrighton, UK An Evaluation on Usability of King Saud University’s VLE from Teachers’ Perspective Supervision Team 1.Dr. Lyn Pemberton 2.Mr. Mithileysh Sathiyanarayanan
  • 2.
    2 A virtual learning environment (VLE) is a tool  used within educational institutions to allow Contentmanagement – creation, storage, access to  and use of learning resources Curriculum mapping and planning – lesson  planning and assessment Communication – emails and notices Virtual Learning Environment (VLE)
  • 3.
    3 VLEs – theteacher view     One-stop shop for different media, interactivity and communication Q&A            
  • 4.
    4 VLEs – theteacher view        Managing learning Designing learning Producing learning     Q&A       
  • 5.
    5 Aim of theStudy The  main  aim  of  the  study  is  to  evaluate  the  effectiveness  of  King  Saud  University's  Virtual  Learning  Environment  (VLE)  from  teachers'  perspective. 
  • 6.
    6 Objectives of theStudy •Investigate the reasons for teachers not using the King Saud University blackboard (VLE) for uploading the study materials to the students? •Investigate the critical factors for a VLE to be successful in teaching and learning. •Investigate the usability problems facing the use of the VLE in King Saud University. •Provide optimal solutions for the usability problems.
  • 7.
    7 •To understand thebackground of Saudi Culture and their education. •To investigate on the usability issues affecting teachers for not using VLE. •To examine various empirical studies (usability) carried out with respect to VLE. •To investigate the questionnaire models that suits the study. •To design the questions and plan the empirical study, to collect the results. •The analysis of the results to be carried and certain guidelines/suggestions/recommendations to be proposed. Tasks for the Study
  • 8.
  • 9.
    9 Step 1: Loginto the system, provide your user id and password. Step 2: Select one of the course that you teach. Step 3: Upload a relevant study material in the course folder. Step 4: Post one message asking the students to access the document you recently uploaded. Step 5: Please answer the questions in section 1 and rate the questions in section 2. Step 6: Please provide your feedback in the "feedback form". Usability Tasks
  • 10.
    10 1. I thinkthat I would like to use this system frequently 2. I found the system unnecessarily complex 3. I thought the system was easy to use 4. I think that I would need the support of a technical person to be able to use this system 5. I found the various functions in this system were well integrated 6. I thought there was too much inconsistency in this system 7. I would imagine that most people would learn to use this system very quickly 8. I found the system very cumbersome to use 9. I felt very confident using the system 10. I needed to learn a lot of things before I could get going SUS Questions
  • 11.
    11 Participants total scorefrom the 10 questions Results - Participants Total Score
  • 12.
    12 Results - AveragePoints for Each Question Average points of each question from the 22 participants.
  • 13.
    13 Further Results Further resultsare illustrated in the thesis.
  • 14.
    14 •Participants were interestedin using Virtual Learning Environment (VLE) in their day-to-day life. •Participants thought VLE was easy to use •Participants felt there were a quite a good features in VLE and they were well integrated. •Participants feel most people would learn to use VLE quickly •Participants felt confident using VLE. Positives from the Study
  • 15.
    15 Negatives from theStudy •Participants felt the VLE was unnecessarily complex. •Participants felt they need support of a technical person to assist them when they use VLE or a proper training. •Participants felt there was lot of inconsistency in the VLE layout. •Participants felt the VLE was cumbersome/awkward. •Finally, they feel they need to learn and get hands on experience before they get going with VLE.
  • 16.
    16 Teachers’ concerns –from Feedback • VLE threaten • Access » Accessibility » Usability » Bandwidth • Communication » Lack of non-verbal actions » No email contact • Expectations low and high » Multimedia not a priority » Demands for flexibility » Inconsistencies in the system » Difficulties accessing material • Reliability
  • 17.
  • 18.