• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty
 

The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty

on

  • 1,264 views

The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty

The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty

Statistics

Views

Total Views
1,264
Views on SlideShare
1,263
Embed Views
1

Actions

Likes
1
Downloads
6
Comments
0

1 Embed 1

https://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-NonCommercial LicenseCC Attribution-NonCommercial License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty Presentation Transcript

    • The Development and Usability Evaluation of a Standards-Based Grading Tool for Faculty
      Alaa Sadik, Sultan Qaboos University (OMAN)
    • Introduction
      Grades are the common method for reporting student performance across universities.
      Today, universities tend to use standards-based assessment approach to assess student performance.
    • Introduction
      Sultan Qaboos University(SQU):
      a cross-cultural organization,
      brings together hundreds of instructors from around the world.
      the largest academic community, consists of 9 colleges,
      awide variance with regard to grading practices.
    • Problem of the Study
      Many instructors believe that:
      Preparing, scoring, grading, and reporting student academic performance are each extremely exhausting and time-consuming tasks.
      It is difficult to perform standards-based assessment according to the university quality assurance policy and requirements.
    • The Need
      Therefore,
      the need was emerged to:
      Use/develop a standards-based assessment tool that allows for more accurate and relevant grading and reporting.
    • Research Questions
      How effective (useful) is the assessment tool in documenting, grading and reporting student performance?
      How efficient (easy to use) is the assessment tool as perceived by users?
      What is the overall satisfaction of users toward the use of the assessment tool?
      What individual difference variables influence instructors’ perceived usability of the assessment tool?
    • Purpose of the Study
      The main purpose of this study was to design, develop and evaluate a standards-based assessment tool for instructors at SQU.
    • Method
      Development of the assessment tool
      A review of the literature
      A series of interviews and focus groups
      were conducted, to determine the gap between the existing grading practices of faculty and those that are needed for the assessment tool.
    • Method
      The assessment tool should
      Support the University grading scale and generate students’ grades automatically;
      Enable qualitative assessment of student performance;
      Attach content and performance standards to grade sheets;
      Have a built-in e-mail function for communicating grades with students;
      Facilitate total point and percent weight of scores and assignments; and
      Generate course statistics for distributions, correlations and variances.
    • Method
    • Method
    • Method
    • Method
    • Method
      Sample
      116 faculty members
      from 4 colleges at SQU.
    • Method
      Procedures
      Participants were asked to perform a series of specific tasks in RealGrade, each of which had several subtasks.
    • Method
      Instruments
      Grading tool usability questionnaire
      To solicit participants’ perceptions toward the effectiveness, efficiency and acceptance of the tool.
      Instructor interviews
      To gain a thorough understanding of the use of RealGrade and to provide rich detail and insights into instructors’ experiences.
    • Results: Questionnaire
      Effectiveness
      Participants strongly agreed or agreed (m=3.93) that RealGrade :
      Is effective in facilitating the process of standards-based assessment,
      Has the tools needed to assess student performance and communicate grades with students, and
      Increases their productivity.
    • Results: Questionnaire
      Efficiency
      Participants indicated that (m=3.34):
      Learning to use RealGrade takes a short time,
      The user interface menus and dialogue boxes are favorable,
      Weighting, assessing, and managing student assignments based on performance standards are very easy tasks.
    • Results: Questionnaire
      Satisfaction
      The majority of participants (m=4.19) reported that they liked and felt comfortable with RealGrade as a tool to assess student performance.
    • Results: Questionnaire
    • Results: Questionnaire
      Participants with greater degrees of computer experience had higher perceptions of effectiveness, efficiency, and satisfaction with RealGrade.
      Participants who had less than five years of teaching experience found RealGrade more effective, efficient and satisfactory than those who had more than five or ten years of experience.
    • Results: Interview
    • Discussion and Conclusions
      Differences among instructors are vital to the eventual acceptance and implementation of the standards-based assessment tool.
      Further research is needed to develop report card to help instructors and students understand the standards-based assessment information included and to make it more comprehensible.
    • Thank You
      More information
      www.alaasadik.net/realgrade
      Contact
      alaasadik@gmail.com