Spring 2012 Dr. Diane Nahl LIS 677 Human Dimension in Information SystemUniversity of Hawaii LIS Program

1. Nahl 2012 LIS 677 Human Dimension in Information Systems 1
DATA ANALYSIS FOR INTERFACE
ASSESSMENT JOURNAL
STRUCTURED SELF-REPORTS &
INSTANT USABILITY TEST FORMS
Spring 2012
Dr. Diane Nahl
LIS 677 Human Dimension in Information System
University of Hawaii
LIS Program

2. Nahl 2012 LIS 677 Human Dimension in Information Systems 2
Self-Report Form Data Analysis
① First step: Examine one of the Forms from an activity and
read all of your/the responses in each section of that
Form.
a. Repeat, read several Forms to become familiar with
your data as a whole.
b. Assign a descriptive short title to each Form and use
those titles in your spreadsheet. Make it descriptive
rather than Task 1, etc., e.g., T5-Boolean Pool
c. Follow the same procedure for IUT Forms, title each
IUT Form with a descriptive code and use the same
code on the spreadsheet.

3. Nahl 2012 LIS 677 Human Dimension in Information Systems 3
Self-Report Form Data Analysis
② Second step: Set up your quantitative evaluation criteria.
a. You may evaluate multi-part tasks or events separately to
record ratings and assign scores to activities based on
success, efficiency, etc. (e.g., T5a-Teleporting, T5b-finding
Boolean Pool, etc.).
b. You may use various approaches but must record and assign
numerical scores for elements in the report. The rating
scales you filled out on your interface behavior (IAJ) and on
other’s interface behavior (IUT) represent numerical sets of
data. You may create others by quantifying your comments
via Content Analysis.
c. If you are willing, share the IUT forms with those who were
your subjects. You are not required to analyze data gathered
on you.

4. Nahl 2012 LIS 677 Human Dimension in Information Systems 4
Self-Report Form Data Analysis
③ Third step: Content Analysis Parsing: identify words
and phrases that indicate a particular aspect,
category, theme or type of comment or explanation.
a. Read through each Form again and highlight words
and phrases or assign categories to responses (e.g.,
highlight positive and negative comments, extract
urgent i-needs, or other elements of interest).
b. Use color highlighters to mark phrases and words in
different categories, e.g. red negative, green positive,
yellow neutral, etc.

5. Nahl 2012 LIS 677 Human Dimension in Information Systems 5
Self-Report Form Data Analysis
④ Fourth step: Copy the Google spreadsheet to record
the ratings and comments from the forms.
a. Transfer the ratings on each Form to the Google
spreadsheet for all of the Forms.
b. Make a row for each task/Form (e.g., T1-Make Poster,
T2-Media Prim, etc.) and columns for rating scales and
enter the ratings in the appropriate column (see
spreadsheet example).

6. Nahl 2012 LIS 677 Human Dimension in Information Systems 6
Self-Report Form Data Analysis
⑤ Fifth step: Sum the rows and compute the average score
for each task portion, and for each task as a whole.
⑤ Sixth step: Sum the columns and compute the average
for each rating scale.
⑤ Seventh step: Sum the total scores for all tasks to get a
global score for the entire set of personal interface
assessment experiences, compute the average.

7. Nahl 2012 LIS 677 Human Dimension in Information Systems 7
Self-Report Form Data Analysis
⑧ Eighth step: Examine the spreadsheet and look for
numerical and narrative patterns, e.g.,
a. What is the range of ratings on each task (positive and
negative rating averages)?
b. Which tasks were most difficult you or a subject?
Which were easiest?
c. What other patterns do you see in your data? These
findings will be part of the Report.