User Engagement - A Scientific Challenge
•Download as PPT, PDF•
7 likes•3,714 views
The document discusses two studies on measuring user engagement: 1. Models of user engagement - Developed models of engagement using clustering and metrics like popularity, activity, loyalty across user groups and time periods. Multiple independent models were found. 2. Saliency, attention and affect - Examined how visual saliency impacts engagement by manipulating page saliency. It measured effects on focused attention, positive/negative affect, and interest using tasks and questionnaires.
![User Engagement – A Scientific Challenge Mounia Lalmas Yahoo! Research Barcelona [email_address] Ioannis Arapakis Ricardo Baeza-Yates Georges Dupret Janette Lehmann Lori McCay-Peet Vidhya Navalpakkam Elad Yom-Tov Collaborators](https://image.slidesharecdn.com/barcelonamarch01v5-120304060040-phpapp01/85/User-Engagement-A-Scientific-Challenge-1-320.jpg)
![Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
More Related Content
What's hot
What's hot (20)
Similar to User Engagement - A Scientific Challenge
Similar to User Engagement - A Scientific Challenge (20)
More from Mounia Lalmas-Roelleke
More from Mounia Lalmas-Roelleke (19)
Recently uploaded
Recently uploaded (20)
User Engagement - A Scientific Challenge
- 1. User Engagement – A Scientific Challenge Mounia Lalmas Yahoo! Research Barcelona [email_address] Ioannis Arapakis Ricardo Baeza-Yates Georges Dupret Janette Lehmann Lori McCay-Peet Vidhya Navalpakkam Elad Yom-Tov Collaborators
- 4. Would a user engage with this web site? http://www.nhm.ac.uk/
- 5. Would a user engage with this web site? http://www.amazingthings.org/ (art event calendar)
- 6. Would a user engage with this web site? http://www.lowpriceskates.com/ (e-commerce – skating)
- 7. Would a user engage with this web site? http://chiptune.com/ (music repository)
- 8. Would a user engage with this web site? http://www.theosbrinkagency.com/ (photographer)
- 10. Characteristics of user engagement (I)
- 11. Characteristics of user engagement (II)
- 12. Forrester Research – The four I’s Measuring Engagement, Forrester Research, June 2008
- 14. Subjective measures Record a user’s perception (generally self-reported) of the technology Two-part processes: Increased use of crowd-sourcing based studies
- 17. Characteristics and measures S. Attfield, G. Kazai, M. Lalmas and B. Piwowarski. Towards a science of user engagement (Position Paper), WSDM Workshop on User Modelling for Web Applications, 2011.
- 19. Page stylistics + layout +links + saliency Measurements and methodologies + online analytics metrics (dwell time, …) + questionnaires + crowd-sourcing - biometrics (eye tracking, mouse tracking, …) Goals + Models of user engagement - Metrics of user engagement Engagement types + attention + emotion + activity + popularity + loyalty - functionality +/- intent & interest user engagement within and across site
- 20. Focus – Two “opposite” studies models USER ENGAGEMENT 1. Models of user engagement 2. On saliency, attention and positive effect activity metrics loyalty metrics popularity metrics hobbies navigation social media e-commerce magazine sport news search weather mail weekly news … focused attention affect (emotion) saliency
- 24. Methodology General models User-based models Time-based models Dimensions 8 metrics 5 user groups 8 metrics per user group weekdays, weekend 8 metrics per time span #Dimensions 8 40 16 Kernel k-means with Kendall tau rank correlation kernel Nb of clusters based on eigenvalue distribution of kernel matrix Significant metric values with Kruskal-Wallis/Bonferonni #Clusters (Models) 6 7 5 Analysing cluster centroids = models
- 29. Focus – Two “opposite” studies models USER ENGAGEMENT 1. Models of user engagement 2. On saliency, attention and positive effect activity metrics loyalty metrics popularity metrics hobbies navigation social media e-commerce magazine sport news search weather mail weekly news … focused attention affect (emotion) saliency
- 31. Manipulating saliency salient condition non-salient condition Web page screenshot Saliency maps
- 39. The big picture ……….… my vision Page stylistics + layout +links + saliency Measurements and methodologies + online analytics metrics (dwell time, …) + questionnaires + crowd-sourcing - biometrics (eye tracking, mouse tracking, …) Goals + Models of user engagement - Metrics of user engagement Engagement types + attention + emotion + activity + popularity + loyalty - functionality +/- intent & interest user engagement within and across site
Editor's Notes
- As said here it is important to differentiate between user experience and user engagement, the latter is an aspect of the former. User engagement related to the positive aspect of the interaction including that of being captivated. Providing technologies with which user engaged is very important, and this is true of any web service. And those are two nice quotes about the importance of engagement.
- Characteristics elaborate the notion of engagement over 3 broad dimensions: emotional, cognitive and behavioural. We identified 8 of them based on previous works / suggested by us. Attention -> exclusivity Affect -> lack of fun can lead as a barrier to shopping (O’Brian) Aesthetics -> promotes attention, stimulate curiosity Endurability -> does the experience meet the expectation?
- Novelty -> freshness of content / has to be carefully balanced Richness = complexity of thoughts and actions, increased complexity/ Affect = relates to the emotion experienced during the interaction (fun and enjoyment)
- The way it often work A two-part process. One is very exploratory, it is important to “probe” carefully, so that indentify all dimension, usually conducted with a small number of users. Highly qualitative, and really the aim is to identify the important characteristics (work of Tom et al did this in 4 areas, online shopping, web searching, educational web casting, and video games). People in HCI knows how to do this well. Then from there, construct more focused studies, but larger scale, and actually measure them in a particular interactive experience, and again going back to the Dalhousie work, they did so for the online shopping scenario. Constructed an online questionnaire, and got 440 responses. Cleaning of data, and factor analysis to reduce the set of characteristics (100) to few key ones (down to 6). Again what I want to make it clear is the methodology, and here the fact we have qualitative data. Would be important to see how the questionnaire developed by them can be used in other area, other domain (IM different to news portal). Health trust Film aesthetics
- In the paper we propose a mapping between objective measures and engagement characteristics, e.g. focused attention can be measured by distorted perception of time, follow-on task performance, and eye tracking Online behaviour = can be large scale IR = special status (metrics) -> Simulated search, user models, linking to user satisfaction