677-Session 11-Data Analysis-S12

325 views

Published on

Spring 2012
Dr. Diane Nahl
LIS 677 Human Dimension in Information System University of Hawaii
LIS Program

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
325
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

677-Session 11-Data Analysis-S12

  1. 1. Nahl 2012 LIS 677 Human Dimension in Information Systems 1 DATA ANALYSIS FOR INTERFACE ASSESSMENT JOURNAL STRUCTURED SELF-REPORTS & INSTANT USABILITY TEST FORMS Spring 2012 Dr. Diane Nahl LIS 677 Human Dimension in Information System University of Hawaii LIS Program
  2. 2. Nahl 2012 LIS 677 Human Dimension in Information Systems 2Self-Report Form Data Analysis① First step: Examine one of the Forms from an activity and read all of your/the responses in each section of that Form. a. Repeat, read several Forms to become familiar with your data as a whole. b. Assign a descriptive short title to each Form and use those titles in your spreadsheet. Make it descriptive rather than Task 1, etc., e.g., T5-Boolean Pool c. Follow the same procedure for IUT Forms, title each IUT Form with a descriptive code and use the same code on the spreadsheet.
  3. 3. Nahl 2012 LIS 677 Human Dimension in Information Systems 3 Self-Report Form Data Analysis② Second step: Set up your quantitative evaluation criteria. a. You may evaluate multi-part tasks or events separately to record ratings and assign scores to activities based on success, efficiency, etc. (e.g., T5a-Teleporting, T5b-finding Boolean Pool, etc.). b. You may use various approaches but must record and assign numerical scores for elements in the report. The rating scales you filled out on your interface behavior (IAJ) and on other’s interface behavior (IUT) represent numerical sets of data. You may create others by quantifying your comments via Content Analysis. c. If you are willing, share the IUT forms with those who were your subjects. You are not required to analyze data gathered on you.
  4. 4. Nahl 2012 LIS 677 Human Dimension in Information Systems 4Self-Report Form Data Analysis ③ Third step: Content Analysis Parsing: identify words and phrases that indicate a particular aspect, category, theme or type of comment or explanation. a. Read through each Form again and highlight words and phrases or assign categories to responses (e.g., highlight positive and negative comments, extract urgent i-needs, or other elements of interest). b. Use color highlighters to mark phrases and words in different categories, e.g. red negative, green positive, yellow neutral, etc.
  5. 5. Nahl 2012 LIS 677 Human Dimension in Information Systems 5Self-Report Form Data Analysis ④ Fourth step: Copy the Google spreadsheet to record the ratings and comments from the forms. a. Transfer the ratings on each Form to the Google spreadsheet for all of the Forms. b. Make a row for each task/Form (e.g., T1-Make Poster, T2-Media Prim, etc.) and columns for rating scales and enter the ratings in the appropriate column (see spreadsheet example).
  6. 6. Nahl 2012 LIS 677 Human Dimension in Information Systems 6Self-Report Form Data Analysis ⑤ Fifth step: Sum the rows and compute the average score for each task portion, and for each task as a whole. ⑤ Sixth step: Sum the columns and compute the average for each rating scale. ⑤ Seventh step: Sum the total scores for all tasks to get a global score for the entire set of personal interface assessment experiences, compute the average.
  7. 7. Nahl 2012 LIS 677 Human Dimension in Information Systems 7Self-Report Form Data Analysis ⑧ Eighth step: Examine the spreadsheet and look for numerical and narrative patterns, e.g., a. What is the range of ratings on each task (positive and negative rating averages)? b. Which tasks were most difficult you or a subject? Which were easiest? c. What other patterns do you see in your data? These findings will be part of the Report.

×