ViBRANT                                                                             Virtual Biodiversity Research      ‘Wi...
ViBRANT                                                                                                                   ...
ViBRANT                                                           Virtual Biodiversity ResearchInterdisciplinary work for ...
ViBRANT                                                          Virtual Biodiversity ResearchWhat is the impact of e-scie...
ViBRANT                                                                       Virtual Biodiversity ResearchMaterialStandar...
ViBRANT                                                                  Virtual Biodiversity ResearchSocial scientists an...
ViBRANT                                                           Virtual Biodiversity ResearchAltmetrics for e-science: a...
ViBRANT                                                     Virtual Biodiversity ResearchMethod computer scientist Identif...
ViBRANT                                    Virtual Biodiversity ResearchResults: Identification of ISPsManually build filt...
ViBRANT                                         Virtual Biodiversity ResearchResults: Clustering ISPs in meaningfulcategor...
ViBRANT                                                   Virtual Biodiversity ResearchWho gains from collaboration betwee...
ViBRANT                                                          Virtual Biodiversity ResearchAcknowledgments  ViBRANT –ht...
Upcoming SlideShare
Loading in …5
×

Wish you were here before!

489 views

Published on

Who gains from collaboration between computer science and social research? Our presentation at 'Interdisciplinary Insights', Oxford, Monday 12 March 2012, organised by the Oxford Internet Institute describing our collaboration in the ViBRANT project.

Published in: Education, Technology, Design
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
489
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • So we had a question, who are the visitors of SPs? And a file with electronic use data ...the challenge then was how to analyse the data and to know how robust the data are. Identify:We decided to start with identifying “the users”. Web analytics packages can be used to generate information on the visitors (users), notably through identification of the names of the visiting Internet Service Providers (ISPs). Through the name of the ISP, (i.e. ‘Vrije Universiteit’) we may be able to identify the nature and activities of the users. Clusters: Additionally, and next to identification we also wanted to cluster the ISP into categories that make sense for evaluation purposes We were in particular interested to see the partition of academic users versus other educational users and sectors such as government and business as this could tell us something about the (societal) impact of the e-infrastructure.
  • The social scientists produced a 181-term filter set after many hours of effort that gave 94% accuracy, whereas the computer scientist produced a 6-term filter set in a couple of minutes that gave 84% accuracy. The tested computer-aided filtering reached a higher precision than the manually‑developed filter (98% vs 92%) though for the recall in this initial test favored the manual approach (73% vs 97%).
  • Meaningful categories in this context are categories that The manual process highlighted a problem with continuing to use keywords to categorize ISPs. Some categories are easily made up from words in the name of the full ISP such as “university” or “research” and could be grouped under the tier one category “research & education”. However, this approach is limited. For example, to simply categorize all ISPs who had within their name the terms “health” or “medic*” as “public health” meant that a range of research, educational, governmental and corporate affiliated ISPs were wrongly classified. Therefore, we were encouraged to categorize ISPs using classifiers rather than by extending our work with filters.
  • Interdisciplinary work of CS and SS will bring to e-science enhanced insights on the actual use and usage of the e-science environment based on robust (log) data and analysis, in a relative short amount of time 2. Social science will benefit from working with CS because of increased scale and speed of data collection and analysis and for their insight in the technological boundaries/charateritics. 3. CS will benefit because collaboration provides opportunity to demonstrate their engineering insights (tool building for the e-science facility as well as tools for analyzing social science data sets); 2) access to large datasets with behavioral/user information which are nice cases to test computer science theories Possible costs: Above we listed several reasons for collaboration between e-science facilities, computer science and social sciences, nevertheless every collaboration does have costs: it requires time in planning and communication. Furthermore, collaborators support each other’s work often at the costs advancing their own research
  • Wish you were here before!

    1. 1. ViBRANT Virtual Biodiversity Research ‘Wish you were here before!’Who gains from collaboration between computer science and social research? Daphne Duin, David King, Peter van den Besselaar Dep. of Organization Sciences & Network Institute, VU-University Amsterdam Department of Computing, The Open University, Milton Keynes Social Science and Digital Research: Interdisciplinary Insights, March, 12, 2012, Oxford e-Research Centre
    2. 2. ViBRANT Virtual Biodiversity ResearchHelp! How is this social data? Time taken to serve the request (microseconds) Host name (equates to Scratchpad) """Full URL"" (in quotes)" Origin of request (IP address) F5 Time the request was received (e#g# (01/Apr/2011:11:17:42 +0100) """First line of request"" (in quotes)" Status of final request (e#g# 200, 301, etc) Size of the response in bytes Remote logname (Almost always blank) """Referer"" (in quotes)" able.myspecies.info http://able.myspecies.info/favicon.ico 24.218.227.223 -- [14/Jul/2010:19:54:06 GET /favicon.ico HTTP/1.1 200 198 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6 polychaetes.info http://polychaetes.info/node/add/forum/forum/ 24.229.196.151 -- [14/Jul/2010:20:16:48 GET /node/add/forum/forum/ HTTP/1.0 301 - http://polychaetes.info/node/add/forum/forum/ Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; Creative) ciliateguide.myspecies.info http://ciliateguide.myspecies.info/node/add/forum/forum/ 24.229.196.151 -- [14/Jul/2010:20:39:14 GET /node/add/forum/forum/ HTTP/1.0 301 - http://ciliateguide.myspecies.info/node/add/forum/forum/ Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19 SW) ciliateguide.myspecies.info http://ciliateguide.myspecies.info/node/add/forum/forum 24.229.196.151 -- [14/Jul/2010:20:39:22 GET /node/add/forum/forum HTTP/1.0 200 25219 http://ciliateguide.myspecies.info/node/add/forum/forum Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19 SW) ciliateguide.myspecies.info http://ciliateguide.myspecies.info/node/add/forum/forum 24.229.196.151 -- [14/Jul/2010:20:39:37 POST /node/add/forum/forum HTTP/1.0 200 27128 http://ciliateguide.myspecies.info/node/add/forum/forum Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19 SW) ciliateguide.myspecies.info http://ciliateguide.myspecies.info/node/add/forum/forum 24.229.196.151 -- [14/Jul/2010:20:39:47 GET /node/add/forum/forum HTTP/1.0 200 25219 http://ciliateguide.myspecies.info/node/add/forum/forum Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19 SW) 26141 wallacefund.info http://wallacefund.info/robots.txt 38.101.148.126 -- [15/Jul/2010:03:48:42 GET /robots.txt HTTP/1.1 200 44 - Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html mhp.myspecies.info http://mhp.myspecies.info/robots.txt 38.101.148.126 -- [15/Jul/2010:03:48:49 GET /robots.txt HTTP/1.1 200 44 - Mozilla/5.0 (compatible; discobot/1.1; +
    3. 3. ViBRANT Virtual Biodiversity ResearchInterdisciplinary work for e-science E-science 1. Application of an e-infrastructure to do science 2. The study of the design, uptake and use of e-Science E-infrastructure: Scratchpads, online platform for biodiversity research Need: Developing alternative evaluation metrics for e- science Goal: Identification of different types of users Approach: Collaboration between social science and omputer science valuable for e-science
    4. 4. ViBRANT Virtual Biodiversity ResearchWhat is the impact of e-science? Question from e-science facility to social scientists Identification of different types of users Who are visiting Scratchpad platform? Web data (eg server log files) Identify Internet Service Providers visiting Scratchpads Cluster Internet Service Providers visiting Scratchpads, into meaningful categories
    5. 5. ViBRANT Virtual Biodiversity ResearchMaterialStandard web analytics report of Scratchpads >300 community sites > 5,000 registred users (unpaid) Public and closed contentNames of 6,728 unique Internet Service Providers (ISPs) (6 months) natural history museum telstra internet verizon online llc freie universitaet berlin queensland department of natural resources and water Gemeente maastricht national parks board (ministry of national development) agriculture and agrifood canada Commission europeenne u.s. fish and wildlife service irm/bfo hqstate of nebraska / office of
    6. 6. ViBRANT Virtual Biodiversity ResearchSocial scientists and computer scientists First trying alone… ….marina|marine|medical|medisch|microsoft|mineral|mining|ministerie| ministry|monsanto|museo|museum|national park|naval|navy|nerc| news|novartis|observatoire|office…. Then question to computer scientist ...from social scientists: could you help us to better... • collect web data? • refine/cluster the data ? • develop tools/methods for measuring robustness of data?
    7. 7. ViBRANT Virtual Biodiversity ResearchAltmetrics for e-science: a social science andcomputer science project “to what extent can we improve a human developed method with computational techniques, in order to cluster ISPs into meaningful categories representing the various audiences using Scratchpads? “
    8. 8. ViBRANT Virtual Biodiversity ResearchMethod computer scientist Identify Internet Service Providers visiting Scratchpads, removing noise Inductive logic program, Aleph Cluster Internet Service Providers visiting Scratchpads into meaningful categories Bayesian classifier
    9. 9. ViBRANT Virtual Biodiversity ResearchResults: Identification of ISPsManually build filter (181 terms)- accuracy 94%- precision 92%- recall 97% Many hours of workComputational filter (6 terms) - accuracy 84%- precision 98%- recall 73% c Couple of minutes
    10. 10. ViBRANT Virtual Biodiversity ResearchResults: Clustering ISPs in meaningfulcategoriesManual method: filter with keywords“university” “research” “school”“museum”Problematic!Computational method: classifiers- 90% accuracy Couple of minutes!
    11. 11. ViBRANT Virtual Biodiversity ResearchWho gains from collaboration betweencomputer science and social research? • E-science facilities, e-science uptake and implementation • Social Science and • Computer Science
    12. 12. ViBRANT Virtual Biodiversity ResearchAcknowledgments ViBRANT –http://vbrant.eu Scratchpads –http://scratchpads.eu/ Laura Hollink for her help with the raw log files Simon Rycroft for his help with the web analytics reports Vince Smith for sharing presentation material

    ×