<ul><li>Social Network Analysis: State of the Art and Challenges </li></ul><ul><li>Noshir Contractor, UIUC & NCSA  </li></...
<ul><li>Description </li></ul><ul><ul><li>Multi-dimensional, multi-relational, multi-layer, multi-rater, ego-centric – dat...
<ul><li>There are now 1 billions books cataloged in WordCat  http:// www.oclc.org/worldcat / </li></ul><ul><li>Brewster Ka...
<ul><li>Description </li></ul><ul><ul><li>Manual (self-report, interviews observation), Sensors, Web-crawling, Automated n...
<ul><li>Description </li></ul><ul><ul><li>Manual, Tagging, Semantic, From Taxonomy to “Folksonomies” </li></ul></ul><ul><l...
<ul><li>Description </li></ul><ul><ul><li>ERGM - Exponential Random Graph Models (Wasserman, Pattison, Robins, Snijders, e...
<ul><li>Description </li></ul><ul><ul><li>Descriptive methods to calculate (simple) network statistics (e.g., centrality o...
Source: Huisman, M.  & Van Duijn, M. A. J. (2005). Software for Social Network Analysis.  In P J. Carrington, J. Scott, & ...
Source: Huisman, M.  & Van Duijn, M. A. J. (2005). Software for Social Network Analysis.  In P J. Carrington, J. Scott, & ...
Source: Huisman, M.  & Van Duijn, M. A. J. (2005). Software for Social Network Analysis.  In P J. Carrington, J. Scott, & ...
<ul><li>Description </li></ul><ul><ul><li>Systems Dynamics </li></ul></ul><ul><ul><li>Agent Based Models </li></ul></ul><u...
<ul><li>Description </li></ul><ul><ul><li>An (animated) image of a network is sometimes worth a list of millions of (dynam...
http://www.visualcomplexity.com/vc/
<ul><li>Description </li></ul><ul><ul><li>Search-based recommendations, Category-based recommendations, Collaborative filt...
<ul><li>Description </li></ul><ul><ul><li>Itineraries – Supporting power users who want to thread multiple programs, data ...
<ul><li>What Other Challenges Exist? </li></ul>
Upcoming SlideShare
Loading in …5
×

Contractor-Borner-SNA-SAC

509 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
509
On SlideShare
0
From Embeds
0
Number of Embeds
29
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Contractor-Borner-SNA-SAC

    1. 1. <ul><li>Social Network Analysis: State of the Art and Challenges </li></ul><ul><li>Noshir Contractor, UIUC & NCSA </li></ul><ul><li>Katy Börner, Indiana University </li></ul><ul><li>Network Data </li></ul><ul><li>Network Data Collection & Extraction </li></ul><ul><li>Network Data Coding </li></ul><ul><li>Network Data Analysis: Methods </li></ul><ul><li>Network Data Visual-Analytics: Implementations and Algorithms </li></ul><ul><li>Network Simulation </li></ul><ul><li>Network Visualization </li></ul><ul><li>Tools for Networking and Referrals </li></ul><ul><li>Network Workflows </li></ul>
    2. 2. <ul><li>Description </li></ul><ul><ul><li>Multi-dimensional, multi-relational, multi-layer, multi-rater, ego-centric – data sets or streams. </li></ul></ul><ul><ul><li>Entities could be people, text, documents, organizations, websites, blogs. </li></ul></ul><ul><ul><li>Datasets vary in number of nodes, and relations/dimensions, subnetworks. </li></ul></ul><ul><ul><li>Culture of benchmark datasets shared: Holland Leinhardt, Sampson, Krackhardt, Enron … many included with software packages such as UCINET. </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Global Information Sector, Blogosphere, Political networks, Emergency Multiorganizational Networks, AP News, Tobacco Control, Multidisciplinary virtual teams, Scientometric networks, Bibliometric Co-author, Co-citation networks, Funding/collaboration networks, (Cell) Phone usage logs, U.S. Census data, GIS data, Capacity of medical facilities, Transit route schedules, etc. </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Intellectual: How networks explain large social phenomena such as diffusion of ideas, creativity, political movements and action, infectious diseases (AIDS, Avian flu), online retailing, mobilization to prepare, respond and recover from disasters? </li></ul></ul>Network Data
    3. 3. <ul><li>There are now 1 billions books cataloged in WordCat http:// www.oclc.org/worldcat / </li></ul><ul><li>Brewster Kahle’s Internet archive captures about 600TB of data http:// www.archive.org / - Michael Macy’s group (Cornell U, Cybertools) </li></ul><ul><li>Google does not list any more how many web pages it indexes. </li></ul><ul><li>Indiana University receives 650 million email messages per year (excluding four times this amount from sites that are non-existent and are blocked). </li></ul><ul><li>Global Information Sector longitudinal dataset of international IT by David Knoke, U Minnesota, companies </li></ul><ul><li>Public Health Epidemiology, Evaluation and Surveillance Data (Gary Giovino, Roswell Park Cancer Center, Brad Hesse/NCI, Pamela Clark/Battelle) </li></ul><ul><li>Instrumenting human interaction (video, speech, and non-verbal interactions) and cognition: Corman/ASU, Cox/NCSA, Pentland/MIT, Bennett Bertenthal/U of Chicago (Cybertools) </li></ul><ul><li>Infectious Disease Epidemiology data – Marathe/Eubank, Virginia Tech </li></ul><ul><li>A large number of small data sets dealing with the same variables or collected using the same instruments that are typically not analyzed collectively, but could be. For instance, ego-centric network datasets. </li></ul>Network Data: Size and Complexity are Growing Fast
    4. 4. <ul><li>Description </li></ul><ul><ul><li>Manual (self-report, interviews observation), Sensors, Web-crawling, Automated network extraction methods: Entity extraction, relation or affiliation extraction </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>EgoNet, CI as a source of data (provenance graphs), Bibliographic data, CITESEER, Web 2.0 technologies (Blogs, RSS feeds, etc), GATE, Crawdad (Corman), D2K & T2K (Welge), VIAS (Craig) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Validation of automated (or computer-augment) approaches to entity and affiliation extraction </li></ul></ul>Network Data Collection: Entity and Affiliation Extraction
    5. 5. <ul><li>Description </li></ul><ul><ul><li>Manual, Tagging, Semantic, From Taxonomy to “Folksonomies” </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Flickr, Tag Cloud, Semantic Grid, Provenance, Social bookmarking, Credentialling </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Self-organizing standards – Metadata, Semantic Grid, Incentives structures for mobilizing communities to contribute </li></ul></ul><ul><ul><li>Adaptiveness to changing Folksonomies </li></ul></ul><ul><ul><li>“ Conservative” tendency towards the mean or majority view </li></ul></ul>Network Data Coding
    6. 6. <ul><li>Description </li></ul><ul><ul><li>ERGM - Exponential Random Graph Models (Wasserman, Pattison, Robins, Snijders, et al) </li></ul></ul><ul><ul><li>Network Evolution – Actor oriented models (Snijders, Steglich) </li></ul></ul><ul><ul><li>Positional analysis – generalized block modeling (Batagelj) </li></ul></ul><ul><ul><li>Autocorrelation Models (Leenders) </li></ul></ul><ul><ul><li>Spectral analysis (Richards, Seary) </li></ul></ul><ul><ul><li>Multi-relational, multi-rater networks (Koehly, Corman) </li></ul></ul><ul><ul><li>Sampling, missing data (Wasserman, Butts) </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Monte Carlo techniques for Maximum Likelihood Estimation of ERGM: Simulate a distribution of random graphs from a starting set of parameter values and to refine these estimated parameter values by comparing the distribution of graphs with observed graph until parameter stabilizes. </li></ul></ul><ul><li>Challenges </li></ul><ul><li>“ However, Monte Carlo approaches to MLE can be computer intensive, so estimation for networks with a large number of nodes, or for a complex model may not be possible or may take an unacceptably long time (p. 157, Wasserman & Robins, 2005). Scalability in terms of size of networks (nodes, number of relationships) and complexity of model – number of parameters to be estimated. </li></ul>Network Data Analysis: Methods
    7. 7. <ul><li>Description </li></ul><ul><ul><li>Descriptive methods to calculate (simple) network statistics (e.g., centrality or transitivity) </li></ul></ul><ul><ul><li>Procedure-based analysis for more complex (iterative) algorithms (e.g., cluster analysis or eigen decomposition) </li></ul></ul><ul><ul><li>Statistical modeling based on probability distributions (e g., Exponential Random Graph Modeling, Quadratic Assignment Procedures) </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Pajek (Vlado), SNA-R/StatNet (Butts), Multinet/PSPAR (Richards/Seary), VOSON (Ackland), StocNet/SIENA (Snijders/Steglich), NetVis (Cummings), JUNG (Fisher) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Data formats interoperability, data integration, data management. </li></ul></ul><ul><ul><li>Open code, doing “bake-offs” using simulation models on benchmark data to explain variance. </li></ul></ul><ul><ul><li>Evaluating and assessing different Markov Chain Monte Carlo (MCMC) algorithms such as Robbins-Monro, Gibbs Sampler, Metropolis Hastings) </li></ul></ul><ul><ul><li>Extensible and scalable software frameworks to ‘plug & play’ diverse algorithms. </li></ul></ul><ul><ul><li>Algorithm and code documentation and learning modules. </li></ul></ul>Network Data Visual-Analytics: Implementations and Algorithms
    8. 8. Source: Huisman, M. & Van Duijn, M. A. J. (2005). Software for Social Network Analysis. In P J. Carrington, J. Scott, & S. Wasserman (Editors), Models and Methods in Social Network Analysis (pp. 270-316). New York: Cambridge University Press. Software for Network Analysis
    9. 9. Source: Huisman, M. & Van Duijn, M. A. J. (2005). Software for Social Network Analysis. In P J. Carrington, J. Scott, & S. Wasserman (Editors), Models and Methods in Social Network Analysis (pp. 270-316). New York: Cambridge University Press. Software for Network Analysis
    10. 10. Source: Huisman, M. & Van Duijn, M. A. J. (2005). Software for Social Network Analysis. In P J. Carrington, J. Scott, & S. Wasserman (Editors), Models and Methods in Social Network Analysis (pp. 270-316). New York: Cambridge University Press. Software Toolkits for Network Analysis
    11. 11. <ul><li>Description </li></ul><ul><ul><li>Systems Dynamics </li></ul></ul><ul><ul><li>Agent Based Models </li></ul></ul><ul><ul><li>Computational Network Models </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Diffusion of information, emergence of norms, coordination of conventions, or participation in collective action (Macy) </li></ul></ul><ul><ul><li>Spread of epidemics EPISIMS (Marathe/Eubank) </li></ul></ul><ul><ul><li>Tobacco control (Clark/Hesse) </li></ul></ul><ul><ul><li>Computational modeling Environments: Repast (Sallach), Blanche (Contractor) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Reusable, transparency, docking, multi-scale simulations, distributed data, doing “bake-offs” on simulation models on benchmark data to explain variance. Theoretical testing and empirical validation. </li></ul></ul>Network Simulation
    12. 12. <ul><li>Description </li></ul><ul><ul><li>An (animated) image of a network is sometimes worth a list of millions of (dynamically changing) node-node pairs. </li></ul></ul><ul><ul><li>In many cases, visuals are the major means to represent and communicate scientific results -- across scientific boundaries. </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Pajek (Batagelj), GUESS (Adar), JUNG (Fisher), MatrixVis (Chris Mueller), TraceEncounters (Paley), TreePlus (Plaisant) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Eye candy vs. highly readable and effective visualizations. </li></ul></ul><ul><ul><li>Visualization of data origin, provenance, accuracy, (un)certainty. </li></ul></ul><ul><ul><li>Tight coupling of data analysis and visualization to help people make sense of very large, dynamically evolving datasets. </li></ul></ul><ul><ul><li>Scalable, interactive/iterative specification of data analysis and data mappings. </li></ul></ul>Network Visualization
    13. 13. http://www.visualcomplexity.com/vc/
    14. 14. <ul><li>Description </li></ul><ul><ul><li>Search-based recommendations, Category-based recommendations, Collaborative filtering: Memory-based, Model-based (clustering), Association rules (or item-to-item collaborative filtering), Content-based methods, Recommendation support Hybrid methods </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>TraceEncounters (Paley), Intellibadge (Donna Cox), I-neighbors (Hampton), AOL (Karahalios), LEEP (Haythornthwaite), CI-KNOW (Contractor), NetExpert (Ramon Sanguesa ), Adaptive Referral Systems (Singh) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Algorithms to capturing data in automated and close to real-time </li></ul></ul><ul><ul><li>Agreement and implementation of metadata, provenance, and </li></ul></ul><ul><ul><li>Developing theoretically grounded and statistically defensible mechanisms for referrals </li></ul></ul><ul><ul><li>Implementation of scalable algorithms </li></ul></ul><ul><ul><li>Privacy benefit trade-offs </li></ul></ul><ul><ul><li>Access to large bibliographic databases </li></ul></ul>Tools for Networking and Referrals
    15. 15. <ul><li>Description </li></ul><ul><ul><li>Itineraries – Supporting power users who want to thread multiple programs, data sets </li></ul></ul><ul><li>Examples </li></ul><ul><ul><li>Kepler and D2K (Welge) </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Agreement and implementation of standards </li></ul></ul><ul><ul><li>Interfacing with existing and new visual-analytic tools, data sets </li></ul></ul>Network Workflows: Tying it all together
    16. 16. <ul><li>What Other Challenges Exist? </li></ul>

    ×