Web application of Antonucci’s hierarchical approach for measuring social networks <ul><ul><li>Gašper Koren, Valentina Hle...
Social Networks data collection on the Web <ul><li>Ego-centered social networks (ego - alters) </li></ul><ul><li>Web quest...
Questionnaire testing <ul><li>Important for valid measurement </li></ul><ul><li>Discover difficulties  </li></ul><ul><li>A...
Network generator
Research questions <ul><li>Is it possible to apply Antonucci's hierarchical approach questionnaire on the Web? </li></ul><...
Experiment outline <ul><li>Monitoring respondents during response process </li></ul><ul><ul><li>WebCam </li></ul></ul><ul>...
Experiments <ul><li>Together with students of Faculty of Social Sciences (“Questionnaire design” course 2006) </li></ul><u...
Questionnaire explained <ul><li>Hands on! </li></ul>
Technology - WebCam
Technology - Eyetracker
Results (WebCam) <ul><li>First circle is problematic and takes long time to understand; less problems with following circl...
Results (Eyetracker) <ul><li>Scanning the questionnaire text, not reading it </li></ul><ul><li>More attracted by graphical...
Results (Focus Groups) <ul><li>Questionnaire is interesting, not too long, even fun. </li></ul><ul><li>How many alters in ...
Results (Cognitive interview) <ul><li>Criteria of putting different alters into different circles is vary among respondent...
Paper or Web? <ul><li>Younger respondents prefer Web over PAP </li></ul><ul><li>Reasons to prefer Web </li></ul><ul><ul><l...
Conclusions <ul><li>We CAN use Web for Antonnuci's hierarhical approach in self interviewing with Web Q. </li></ul><ul><li...
Don't do it at home! What we have learned from technology perspective? <ul><li>WebCam and technology around it is relative...
Further research <ul><li>Improve Web application according to comments we got from pilot study </li></ul><ul><li>Expert ev...
[email_address] http://www.websm.org/
Upcoming SlideShare
Loading in …5
×

Web application of Antonucci's hierarchical approach for measuring social networks (SMABS2006)

1,117 views
1,059 views

Published on

Presentation on SMABS2006 conference, Budapest, Hungary, July 2006

Published in: Economy & Finance, Technology
2 Comments
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total views
1,117
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
49
Comments
2
Likes
0
Embeds 0
No embeds

No notes for slide

Web application of Antonucci's hierarchical approach for measuring social networks (SMABS2006)

  1. 1. Web application of Antonucci’s hierarchical approach for measuring social networks <ul><ul><li>Gašper Koren, Valentina Hlebec </li></ul></ul><ul><ul><li>Faculty of Social Sciences </li></ul></ul><ul><ul><li>University of Ljubljana </li></ul></ul><ul><ul><li>SMABS Budapest, 5. July 2006 </li></ul></ul>
  2. 2. Social Networks data collection on the Web <ul><li>Ego-centered social networks (ego - alters) </li></ul><ul><li>Web questionnaires </li></ul><ul><li>Questionnaire testing methods </li></ul>
  3. 3. Questionnaire testing <ul><li>Important for valid measurement </li></ul><ul><li>Discover difficulties </li></ul><ul><li>Avoid systematic mistakes </li></ul><ul><li>Improvements of questionnaire in early phase (pre-field testing) </li></ul><ul><li>Extremely important when </li></ul><ul><ul><li>we are using uncommon questionnaires </li></ul></ul><ul><ul><li>we are introducing new technologies </li></ul></ul>
  4. 4. Network generator
  5. 5. Research questions <ul><li>Is it possible to apply Antonucci's hierarchical approach questionnaire on the Web? </li></ul><ul><li>How the respondents act to that kind of questionnaire? </li></ul><ul><li>What are the main pitfalls when adopting difficult questionnaire from F2F interviewing for the on-line data collection </li></ul>
  6. 6. Experiment outline <ul><li>Monitoring respondents during response process </li></ul><ul><ul><li>WebCam </li></ul></ul><ul><ul><li>EyeTracker </li></ul></ul><ul><li>Qualitative methods after answering the questionnaire </li></ul><ul><ul><li>Focus groups </li></ul></ul><ul><ul><li>Cognitive interview (retrospective think aloud) </li></ul></ul>
  7. 7. Experiments <ul><li>Together with students of Faculty of Social Sciences (“Questionnaire design” course 2006) </li></ul><ul><li>29. March and 5. April 2006 </li></ul><ul><li>4 groups of students: </li></ul><ul><ul><li>WebCam + Focus group </li></ul></ul><ul><ul><li>WebCam + Cognitive interview </li></ul></ul><ul><ul><li>EyeTracker + Focus group </li></ul></ul><ul><ul><li>EyeTracker + Cognitive interview </li></ul></ul>
  8. 8. Questionnaire explained <ul><li>Hands on! </li></ul>
  9. 9. Technology - WebCam
  10. 10. Technology - Eyetracker
  11. 11. Results (WebCam) <ul><li>First circle is problematic and takes long time to understand; less problems with following circles </li></ul><ul><li>Some more “difficult” questions require more cognitive effort and more time; this often includes multiple readings of the question </li></ul><ul><li>“Reading with mouse” </li></ul><ul><li>Technical difficulties: </li></ul><ul><ul><li>We should add “delete” feature for alters </li></ul></ul><ul><ul><li>Not clear enough that alters are movable </li></ul></ul><ul><ul><li>Warnings are sometimes confusing </li></ul></ul>
  12. 12. Results (Eyetracker) <ul><li>Scanning the questionnaire text, not reading it </li></ul><ul><li>More attracted by graphical elements than text; non-bold text is completely missed. </li></ul><ul><li>Only some respondents return to the question when they find out that they don't know what to do. </li></ul><ul><li>We should mark the changes of the questions if graphics stays similar! </li></ul>
  13. 13. Results (Focus Groups) <ul><li>Questionnaire is interesting, not too long, even fun. </li></ul><ul><li>How many alters in each circle? </li></ul><ul><li>Unknown length of the questionnaire </li></ul><ul><li>More detailed instructions? :) </li></ul><ul><li>Feedback at the end of the questionnaire </li></ul><ul><li>Technical problems </li></ul>
  14. 14. Results (Cognitive interview) <ul><li>Criteria of putting different alters into different circles is vary among respondents. </li></ul><ul><li>When examine the network characteristics, respondents figure out that they didn't fill out the network generator with all potential alters. </li></ul>
  15. 15. Paper or Web? <ul><li>Younger respondents prefer Web over PAP </li></ul><ul><li>Reasons to prefer Web </li></ul><ul><ul><li>More interactive </li></ul></ul><ul><ul><li>Better overview of your personal network </li></ul></ul><ul><li>Reasons to prefer PAP </li></ul><ul><ul><li>computer literacy problems </li></ul></ul>
  16. 16. Conclusions <ul><li>We CAN use Web for Antonnuci's hierarhical approach in self interviewing with Web Q. </li></ul><ul><li>Pretesting with different methods gave us very precious results and suggestions for improvements </li></ul><ul><li>“Interesting questionnaire, better than PAP”, even “fun” </li></ul>
  17. 17. Don't do it at home! What we have learned from technology perspective? <ul><li>WebCam and technology around it is relatively simple and cheap </li></ul><ul><li>EyeTracking device should cost at least 20.000 EUR ;) </li></ul><ul><li>Internet should work when doing the experiments! </li></ul>
  18. 18. Further research <ul><li>Improve Web application according to comments we got from pilot study </li></ul><ul><li>Expert evaluation (autumn 2006) </li></ul>
  19. 19. [email_address] http://www.websm.org/

×