A USABILITY STUDY WITH CHILDREN AND SMARTBOARD TECHNOLOGY:
IMPROVING OUR METHODS IN DATA COLLECTING
AND GATHERING TECHNIQUE
Laili Farhana Md Ibharim & Maizatul Hayati Mohamad Yatim
Faculty of Arts, Computing and Creative Industry
Universiti Pendidikan Sultan Idris
35900, Tanjong Malim
Problem We Face
• A method of collecting and gathering data
used by researcher in their studies against
children is sometimes a bit messy and the
results are less accurate.
• Method use not appropriate to the
environment and the acceptance of children.
• Usability issues using technology with
Solution We Offer
A new method how to collect and gather data
for children using Smartboard technology.
• Objective of this paper is :
To evaluate the usability of Smartboard
application as a new tool to collect and gather
data for usability testing with children.
Development Of Smartboard
• Refer to DDD-E model
• Using SMART Notebook 10
• The application is mainly about to introduce
icon design and its function to early age
• The combination of drill & practice and game
approach implemented in 6 activities. (fun
and interest element injected)
• Participant • Location
• Nine children aged 7 to 12 years old.
• This level of age are concrete
operations and formal operational for
children's development. (Jean Piaget)
•Animation Lab of Sultan Idris Education
•Convenient place to conduct usability
testing with complete facilities and
Usability Testing (cont)
• Method : Intensive use, fun and creativity test
& Usability Testing Guidelines.
• Instrument : Observation with video recorder.
• Strategy :
Session Time Activity / Test
1 7 minutes X 9
Participants play with the application one by one
continuously in a separate room. All inputs (child
artifact and questionnaire saved in each
individual file). Researchers do observation on
participants and record it using video recorder.
2 Researchers collect all the data and analyze it
Result 1 : Efficiency
• Efficiency measured based on time taken for
each participant to finish the activities.
Summary : Six participants have completed each activity were below from the
researchers estimated time (7 minutes).
Result 2 : Effectiveness
• Effectiveness measured based on marks or
scores for each participants in Matching, Drag
and drop and Pairing activity.
Matching activity : All participants got full marks (Very good)
Drag & Drop activity : 6 participants got full marks and none got 0 (Good)
Pairing : All participants got score above 5 (Very good)
Result 3 : Satisfaction
• Five categories of expression recorded by the researcher
for each participant to see their level of satisfaction when
handling the activities on Smartboard.
Summary: Researchers can see the positive form of expression that was
dominating the participants while handling the activities on Smartboard
Facial Expression Positive: Happy, excited, focus, laugh, confident, eager to try, smile
Negative: Confuse, uncomfortable, not sure, not satisfy, frowning
Speech Expression Positive: Asking for confirmation (example: “buat kat sini?”), asking to do again (example: “nak buat
lagi”), feel happy when success (example: “Yes!”, “dah!”)
Negative: Confuse (example: “eh?”, “aik?”), giving up (example: “susahnye..”, “takpelah..”,
“aahhhh!!!”), unsatisfied (example: “ eh..bukanlah..” , “nak tukar”)
Positive: Face the board confidently, handling tools in the right way, step backward and forward
(thinking), finger tap on the board (thinking)
Negative:Touch head/nose/eye, eyes always staring at the teacher, body sway gently to left and
right, head moving, hand swinging, one hand on the board and other hand to stomach and waist,
Movement Expression Positive: Fast, direct, immediately action, free movement around the board, efficient
Attitude Expression Positive: Active, motivated, make effort, high confidence level, perfectionist, creative
Negative: Too alert, too detail, afraid to try, giving up easily.
No.1 : Similarity and familiarity of Smartboard
application with real world make it function
No.2 : Collecting and gathering data from children
can be easy using Smartboard application.
No.3 : Children show good behavior and attitude
while using Smartboard application.
No.4 : Multimodal interaction enhances children
performance in giving idea and information.
Smartboard is very helpful in collecting and gathering data
from children through activities that allow them to
communicate, give ideas and opinions openly and clearly.
Advantage to researchers in the field of children to obtain
data for their studies through the Smartboard as compared
to the common methods such as questionnaires and
The applicability of this study is to prove that Smartboard
as a tool to gather and collect data to create new methods
of study in children to be more interesting, effective and
• Ackermann, E. (2004). Constructing Knowledge and Transforming the World. M. Tokoro and L. Steels (Eds.). A
Learning Zone of One’s Own: Sharing Representations and Flow in Collaborative Learning Environments.
Amsterdam: IOS Press, Pt. 1, Ch. 2, pp. 15-37.
• Edwards, H. & Benedyk, R. (2007). A Comparison of Usability Evaluation Methods for Child Participants in A School
Setting. In proceeding of The 6th International Conference for Interaction Design and Children (pp. 9-15)
• Gage, J. (2005). How to Use an Interactive Whiteboard Really Effectively in Your Primary Classroom. London: David
Fulton Publishers Ltd.
• Ivers, K.S. & Barron, A.E. (2006). Multimedia Projects in Education: Designing, Producing and Assessing (3rd Ed.).
USA: British Library.
• Microsoft. (2011). Icons. Retrieved March 22, 2011 from http://msdn.microsoft.com/en-
• Hanna, L., Risden, K., Czerwinski, M., & Alexander, K.J. (1998). The Role of Usability Study in Designing Children’s
Computer Products. In: The Design of Children’s Technology. Druin, A. (Ed.), Morgan Kaufmann Publishers:
San Francisco, CA, USA.
• Masuch, M., Yatim, M., & Gadegast, P. (2007). Developing Software for Children: Experiences from Creating a 3D
Drawing Application. In: Gross, T. (ed.). Mensch & Computer 2007: Konferenz fur interactive und
cooperative Medien. Munchen: Oldenburg Verlag.pp. 179 – 188.
• Preece, J., Rogers, Y. & Sharp, H. (2006). Interaction Design Beyond Human-Computer Interaction (2nd ed.). USA :
John Wiley & Sons, Ltd.
• Robson, C. (2002). Real World Study (2nd Ed.). Blackwell Publishing.
• Rubin, J. & Chisnell, D. (2008). Handbook of Usability Testing: How to Plan, Design and Conduct Effectiveness Tests
(2nd Ed.).Indianapolis: Wiley Publishing.