Cognitive Analysis of Web Site NavigationAimee Maree Forsstrom BAppCompPost Graduate Research Student Southern Cross University  School of Information TechnologyResearch performed under the supervision of Dr Graham Cooper
Human Cognitive Architecture Image from http://education.arts.unsw.edu.au/staff/sweller/clt/
Plus or Minus Two the Magical Number SevenThe Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information * Short-term memory is restricted to just a few bits of information, this famous paper by George A Miller showed among other things how chunking could be employed to increase the restricted capacity of short-term memory. *originally published in The Psychological Review, 1956, vol. 63, pp. 81-97  http://www.musanim.com/miller1956/
Cognitive Load TheoryCognitive load refers to the total amount of mental activity imposed on working memory at an instance in time.This theory suggests that learning happens best under conditions that are aligned with human cognitive architecture. Sweller, J., Instructional Design in Technical Areas, (Camberwell, Victoria, Australia: Australian Council for Educational Research (1999).
The Three Main Types of Cognitive LoadIntrinsic cognitive load; Cannot be changed, this is due to the inherent difficulty associated with the information presented. Extraneous cognitive load; Unnecessary cognitive load generated by the manner in which information is presented to learners and is under the control of designers (Cooper 1998). Germane cognitive load; devoted to the processing, construction and automation of schemata (long term memory)” (Sweller 1999).
With Cognitive Load Theory we can Reduce the Required Mental EffortWhen intrinsic cognitive load is low (simple content) sufficient mental resources remainIf the intrinsic cognitive load is high and the extraneous cognitive load is high total cognitive load will exceed.Modifying instructional materials to engineer a lower level of extraneous cognitive load will facilitate learning.
Cognitive load theory focuses on the role of working memory in the learning processWorking memory is extremely limited.Long term memory is essentially unlimited.The process of learning requires working memory to be actively engaged in the comprehension of instructional material to encode into long term memory.If the resources of working memory are exceeded then learning will be ineffective.
Why Web Site Navigation and CLT?As we navigate and learn our way through a web site we are interacting with and processing informationWith the uptake of the web and the use of the web for business applications Navigation becomes more important to our efficient use of the web
Main way we access information – the internetWeb Site Navigation is Instructional Design Navigation is the instruction we use to locate and move our way through a web site
Not just static but interactive The web has become Interactive No longer do we just surf/browse for informationBut we interact with it and perform tasks
Task Driven Navigation With the rise of content management systems most websites these days are maintained by task driven interactionWebsites such as Twitter, facebook, bebo, linkedin, myspace are task driven not browse and searchWe visit these websites to perform tasks and interact with the informationAll this interacting changes the way we navigate around the web
All this information can overload our Memory* Image from http://my.opera.com/englishlearning/blog/shor-term-memory
Can we analyse if people have interpreted information on a web site?Yes, this is where Cognitive Load Theory and Cognitive Analysis comes into play...We don't just test if people enjoy and can use the website but we access how much information they have been able to process whilst interacting with it.
How do we prove instructional design is betterWe run Controlled Experiment/s We take two groups of peopleOne with the normal instruction (Control Group)One with the changed instruction (Experiment Group)We then look at the test results to see if there is any statistical difference between the groupsIf there is a statistical difference then the instructional change has benefited the interpretation of that information
Example of Cognitive Load Web Based  Experiment Game was designed to mimic task driven navigationTwo groups where used with different navigation typesNavigation design change looked into was CSS position:fixed (use of static menus)
Experiment DesignParticipants where taken through a navigation game (Random Facts Game)Asked to complete a mental effort surveyAsked to complete a “Fill in the Facts” questionnaire from the random facts learnt in the gameAsk to perform a rebuild of the navigation menu (to show uptake of schema) Asked to complete a usability survey and provide quantitative feedback
Preliminary Results from ExperimentThe experiment group was more efficient in time for navigation steps, statistical significance found.From the “Fill in the Facts” questionnaire we can see a statistical difference in the overall scores out of 17 questions, the experiment group scored higher in 14 and in all the harder questions. From the Navigation Schema rebuild we can see a statistical difference in overall schema rebuild In qualitative analysis 47% of the control group complained about the navigation whilst only 17% complained in the experiment group
What does it help us UnderstandFrom this research we can see a trend that if we change the web site navigation to adhere to cognitive load then people are able to take in the information moreWe can form a conclusion that the group with better navigation had a lower incidence of cognitive over load and hence were able to interpret the information and also interact with more elements of the informationSome statistical differences found and trends present which present the need for further research into this effect
Why is Cognitive Analysis NeededTask Driven Navigation not just seek and findWeb as become a hub of activity where we work not just playMore business is being done online, more people are forced to interact with websites for there workStop the guess work, are people taking in and interacting with the information on our web sitesExamples of sites that could use Cognitive AnalysisGovernment portal sites where access to worthwhile information is why people visit themContent Management Systems (example Drupal Admin Menu) Task driven and business based web applications
Now that we have passed the “Wow” factor of the web, it is the time for us as web engineers to ensure that the user experience is paramount. No longer can we just design web sites for us or for the business but we need to consider how people are interacting with and interpreting our information.Aimee Maree Forsstrom  2009

Cognitive analysis of web site navigation

  • 1.
    Cognitive Analysis ofWeb Site NavigationAimee Maree Forsstrom BAppCompPost Graduate Research Student Southern Cross University School of Information TechnologyResearch performed under the supervision of Dr Graham Cooper
  • 2.
    Human Cognitive ArchitectureImage from http://education.arts.unsw.edu.au/staff/sweller/clt/
  • 3.
    Plus or MinusTwo the Magical Number SevenThe Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information * Short-term memory is restricted to just a few bits of information, this famous paper by George A Miller showed among other things how chunking could be employed to increase the restricted capacity of short-term memory. *originally published in The Psychological Review, 1956, vol. 63, pp. 81-97 http://www.musanim.com/miller1956/
  • 4.
    Cognitive Load TheoryCognitiveload refers to the total amount of mental activity imposed on working memory at an instance in time.This theory suggests that learning happens best under conditions that are aligned with human cognitive architecture. Sweller, J., Instructional Design in Technical Areas, (Camberwell, Victoria, Australia: Australian Council for Educational Research (1999).
  • 5.
    The Three MainTypes of Cognitive LoadIntrinsic cognitive load; Cannot be changed, this is due to the inherent difficulty associated with the information presented. Extraneous cognitive load; Unnecessary cognitive load generated by the manner in which information is presented to learners and is under the control of designers (Cooper 1998). Germane cognitive load; devoted to the processing, construction and automation of schemata (long term memory)” (Sweller 1999).
  • 6.
    With Cognitive LoadTheory we can Reduce the Required Mental EffortWhen intrinsic cognitive load is low (simple content) sufficient mental resources remainIf the intrinsic cognitive load is high and the extraneous cognitive load is high total cognitive load will exceed.Modifying instructional materials to engineer a lower level of extraneous cognitive load will facilitate learning.
  • 7.
    Cognitive load theoryfocuses on the role of working memory in the learning processWorking memory is extremely limited.Long term memory is essentially unlimited.The process of learning requires working memory to be actively engaged in the comprehension of instructional material to encode into long term memory.If the resources of working memory are exceeded then learning will be ineffective.
  • 8.
    Why Web SiteNavigation and CLT?As we navigate and learn our way through a web site we are interacting with and processing informationWith the uptake of the web and the use of the web for business applications Navigation becomes more important to our efficient use of the web
  • 9.
    Main way weaccess information – the internetWeb Site Navigation is Instructional Design Navigation is the instruction we use to locate and move our way through a web site
  • 10.
    Not just staticbut interactive The web has become Interactive No longer do we just surf/browse for informationBut we interact with it and perform tasks
  • 11.
    Task Driven NavigationWith the rise of content management systems most websites these days are maintained by task driven interactionWebsites such as Twitter, facebook, bebo, linkedin, myspace are task driven not browse and searchWe visit these websites to perform tasks and interact with the informationAll this interacting changes the way we navigate around the web
  • 12.
    All this informationcan overload our Memory* Image from http://my.opera.com/englishlearning/blog/shor-term-memory
  • 13.
    Can we analyseif people have interpreted information on a web site?Yes, this is where Cognitive Load Theory and Cognitive Analysis comes into play...We don't just test if people enjoy and can use the website but we access how much information they have been able to process whilst interacting with it.
  • 14.
    How do weprove instructional design is betterWe run Controlled Experiment/s We take two groups of peopleOne with the normal instruction (Control Group)One with the changed instruction (Experiment Group)We then look at the test results to see if there is any statistical difference between the groupsIf there is a statistical difference then the instructional change has benefited the interpretation of that information
  • 15.
    Example of CognitiveLoad Web Based Experiment Game was designed to mimic task driven navigationTwo groups where used with different navigation typesNavigation design change looked into was CSS position:fixed (use of static menus)
  • 16.
    Experiment DesignParticipants wheretaken through a navigation game (Random Facts Game)Asked to complete a mental effort surveyAsked to complete a “Fill in the Facts” questionnaire from the random facts learnt in the gameAsk to perform a rebuild of the navigation menu (to show uptake of schema) Asked to complete a usability survey and provide quantitative feedback
  • 17.
    Preliminary Results fromExperimentThe experiment group was more efficient in time for navigation steps, statistical significance found.From the “Fill in the Facts” questionnaire we can see a statistical difference in the overall scores out of 17 questions, the experiment group scored higher in 14 and in all the harder questions. From the Navigation Schema rebuild we can see a statistical difference in overall schema rebuild In qualitative analysis 47% of the control group complained about the navigation whilst only 17% complained in the experiment group
  • 18.
    What does ithelp us UnderstandFrom this research we can see a trend that if we change the web site navigation to adhere to cognitive load then people are able to take in the information moreWe can form a conclusion that the group with better navigation had a lower incidence of cognitive over load and hence were able to interpret the information and also interact with more elements of the informationSome statistical differences found and trends present which present the need for further research into this effect
  • 19.
    Why is CognitiveAnalysis NeededTask Driven Navigation not just seek and findWeb as become a hub of activity where we work not just playMore business is being done online, more people are forced to interact with websites for there workStop the guess work, are people taking in and interacting with the information on our web sitesExamples of sites that could use Cognitive AnalysisGovernment portal sites where access to worthwhile information is why people visit themContent Management Systems (example Drupal Admin Menu) Task driven and business based web applications
  • 20.
    Now that wehave passed the “Wow” factor of the web, it is the time for us as web engineers to ensure that the user experience is paramount. No longer can we just design web sites for us or for the business but we need to consider how people are interacting with and interpreting our information.Aimee Maree Forsstrom 2009