Navigation design with respect to cognitive load


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • As your research topic is “Navigation Design with Respect to Cognitive Load”, the research question should be associated with cognitive load. Or you should have a slide of introduction or explanation about how static navigation design relates to cognitive load. Your audience may not know cognitive load theory and static navigation. You should explain them, and dynamic navigation for comparison. You should explain “benefit”. The above is needed for understanding your research question. You identified the following tasks for the research, which are important. For research methodology, you should describe how they will be done (procedure). Examine User Search Goals and Purposes Study how People Navigate a Web Site Examine Human Centred Navigation Design Examine Web Site Information Architecture Examine the application of Cognitive Load Theory Develop Navigation with respect to Cognitive Load Reduction Measure the effectiveness of Navigation Design on a Persons Cognitive Load Create Navigation Development Guidelines based on results from experiments You may consider the following from Wikipedia for methodology Methodology includes the following concepts as they relate to a particular discipline or field of inquiry: a collection of theories, concepts or ideas; comparative study of different approaches; and critique of the individual methods ' Methodology refers to more than a simple set of methods; rather it refers to the rationale and the philosophical assumptions that underlie a particular study. This is why scholarly literature often includes a section on the methodology of the researchers. This section does more than outline the researchers’ methods (as in, “We conducted a survey of 50 people over a two-week period and subjected the results to statistical analysis”, etc.); it might explain what the researchers’ ontological or epistemological views are.
  • Measures The measures that would be used to measure the validity of the hypostatises would be the dependent variables of; Time/speed (the number and time of moves between beginning and end of navigation task) Cognitive load (users ability to recall information after performing navigation tasks, users stated level of cognitive ease) ******** You should describe treatment condition and original condition You should explain the “information” in “recall information”. Aldo “user’s ability” is confusing. Do you measure cognitive load on the user or user’s knowing ability?
  • It’s confusing to see “experiment group” under the title of “control group design” Explain X Describe “dependent variable” Explain “test units”
  • “ Controlled Experiment Design” should be at a higher level of the bullet list (I have made the change.) You should define/explain the terms/phrases: control group, experiment group, one set, observed online, observed face to face.
  • Explain “ internet/computer use” You may be asked why data of sex, age, internet/computer and connection speed are collected. Are they independent variables? If they are, a large sample size is needed. doing as CONTROL variables (balanced allocation to account for effect) but not the effects of interest - controlling to reduce variability and raise power.
  • Audience may ask why 7 tasks original condition and treatment condition should have been described/defined. and what are the 7 tasks? - see my previous email response....try to stretch the tasks out so some are simple/ similar test questions....working up to more complex and/or Transfer questions. This gives scope of "seeing" somewhere, on the sliding scale, difference between groups.
  • Try to be consistent in used terms, does post-test mean “ Short Quiz after experiment task completion”? Are the 7 questions the same for all tasks? You should what questions they are. How can one associate “recall information” with navigation design or navigation process. One may be able to find the information quickly or with few link clicks, but may feel difficult to remember the information. Another one may spend a longer time or click more links to get the information, but may feel easy to remember the information. How would you compare them in regard to navigation or cognitive load? you are interested in comparing between GROUPS rather than tasks when such confounds are present.
  • This slide should be moved to a position before Slide 6. Does “ User mouse movement” also relate to user’s habit of using a mouse? How will you use the “heat map log” in data analysis? What is more important is what data will be collected and how they will be used/analyses for the research. you are capturing aspects of both Quantitative and Qualitative data. Hope is that triangulation indicates supportive results between these two braod types of measures.
  • Navigation design with respect to cognitive load

    1. 1. Navigation Design with Respect to Cognitive Load Reduction Research Methodology Presentation
    2. 2. Research Question <ul><li>Does static navigation reduce a users cognitive load </li></ul>
    3. 3. Hypotheses <ul><li>H1 = ( navigation efficiency ) Treatment condition participants perform faster navigation then the original condition participants . </li></ul><ul><li>H0 = ( navigation efficiency ) Treatment condition participants do not perform faster navigation then the treatment condition participants . </li></ul><ul><li>H2 = ( mental effort ) Treatment condition participants show reduced Cognitive Load compared to the treatment condition participants . </li></ul><ul><li>H0 = ( mental effort ) Treatment condition participants do not show reduced Cognitive Load compared to the original condition participants . </li></ul>
    4. 4. Research Methodology <ul><li>Controlled Experiment Design </li></ul><ul><li>Participant Groups </li></ul><ul><li>Questionnaire </li></ul><ul><li>Experiment Tasks </li></ul><ul><li>Short Quiz </li></ul><ul><li>Survey </li></ul><ul><li>Data Collection Methods </li></ul>
    5. 5. Post-Test Control Group Design <ul><li>X = exposure of group to dependent variable </li></ul><ul><li>O = observation of the dependent variable </li></ul><ul><li>R = random assignment of test participants </li></ul><ul><li>Dependent variable = navigation </li></ul><ul><ul><li>Two levels </li></ul></ul><ul><ul><ul><li>Static </li></ul></ul></ul><ul><ul><ul><li>Non static </li></ul></ul></ul>Online www Face to face Experiment Group R O 1 X O 2 Control Group R O 3 O 4
    6. 6. Experiment Design <ul><li>Controlled Experiment Design </li></ul><ul><ul><li>Control Group x2 </li></ul></ul><ul><ul><li>Experiment Group x2 </li></ul></ul><ul><ul><li>One set of groups will be observed online </li></ul></ul><ul><ul><ul><li>experiment to be conducted online </li></ul></ul></ul><ul><ul><li>One set of groups will be observed face to face </li></ul></ul><ul><ul><ul><li>Experiment to be conducted in a classroom at Coffs Harbour SCU </li></ul></ul></ul>
    7. 7. Website Factors <ul><li>Control </li></ul><ul><ul><li>Screen content – text – image – colour – content layout </li></ul></ul><ul><ul><li>Sex – 50% male – 50% female </li></ul></ul><ul><ul><li>Computer and internet use frequency – medium to high level </li></ul></ul><ul><ul><li>Internet connection speed </li></ul></ul><ul><ul><li>Search bar – will be turned off so users have to follow a navigational path </li></ul></ul><ul><ul><li>Post graduate student and university staff </li></ul></ul><ul><li>Independent </li></ul><ul><ul><li>Navigation design – static – non static </li></ul></ul><ul><li>Dependent </li></ul><ul><ul><li>Time – time taken from server and computer log files </li></ul></ul><ul><ul><li>Information Recall - [ easy > < difficult ] </li></ul></ul><ul><li>Treatment </li></ul><ul><ul><li>Credibility [ easy >< difficult ] </li></ul></ul><ul><ul><li>Cognitive friction [ not >< very ] </li></ul></ul><ul><li>Factor </li></ul><ul><ul><li>Navigation Mechanism </li></ul></ul><ul><li>Level </li></ul><ul><ul><li>Two levels - static - non static </li></ul></ul>
    8. 8. Participants <ul><li>Knowledge Workers </li></ul><ul><ul><li>Post Graduate Students </li></ul></ul><ul><ul><li>Academic Staff </li></ul></ul><ul><li>Online invitations to participate in study on higher education websites </li></ul><ul><li>Email to University Faculty and Post Graduate Departments </li></ul>
    9. 9. Questionnaire <ul><li>Pre test questionnaire to capture control factors about participants </li></ul><ul><ul><li>Capture sex, age, internet/computer use for all participants </li></ul></ul><ul><ul><li>Capture internet connection speed for online participants </li></ul></ul><ul><li>Controlling to reduce variability and raise power </li></ul><ul><ul><li>Balanced allocation to account for effect </li></ul></ul>
    10. 10. Experiment Tasks <ul><li>Participants are given a sheet with seven tasks – no time limit for tasks </li></ul><ul><li>Randomly assigned original condition or treatment condition website </li></ul><ul><li>Each online participant is assigned a unique ID, which is used to track the participant’s link clicks </li></ul>
    11. 11. Quiz <ul><li>Short Quiz after experiment task completion </li></ul><ul><ul><li>Seven questions about each specific experiment task </li></ul></ul><ul><ul><li>Recall information from website to see if participants were able to retain the information that was found </li></ul></ul>
    12. 12. Usability Survey <ul><li>10 questions about websites usability </li></ul><ul><li>Likert scale questions </li></ul><ul><li>Capture users perception of </li></ul><ul><ul><li>Navigation Usability </li></ul></ul><ul><ul><li>Navigation Design </li></ul></ul><ul><ul><li>Website Credibility </li></ul></ul><ul><ul><li>Navigation Promience </li></ul></ul><ul><ul><li>Cognitive Friction </li></ul></ul>
    13. 13. Data Collection Methods <ul><li>User hyperlink clicks (server log files ) </li></ul><ul><li>Questionnaire (database) </li></ul><ul><li>Survey (database) </li></ul><ul><li>Quiz (database) </li></ul><ul><li>Questions or concerns raised (email or telephone, notes taken on issues raised, participant remains anonymous unless otherwise stated) </li></ul><ul><li>All participant records are stored against an ID number and not personal records </li></ul>
    14. 14. Experiment Timeline <ul><li>Ethics Application </li></ul><ul><ul><li>October 2008 </li></ul></ul><ul><li>Online Experiment Invitations </li></ul><ul><ul><li>November 2008 </li></ul></ul><ul><li>Online experiment active </li></ul><ul><ul><li>December 2008 to April 2009 </li></ul></ul><ul><li>Face to Face experiment (over 2 weeks) </li></ul><ul><ul><li>March 2009 </li></ul></ul><ul><li>Data Collection complete </li></ul><ul><ul><li>April 2009 </li></ul></ul>
    15. 15. Questions or Comments?