SlideShare a Scribd company logo
1 of 30
Download to read offline
Information Foraging: Tuesday, 9:00 AM - 10:30 AM
An Elementary Social Information Foraging Model
Peter Pirolli
Remembrance of Things Tagged: How Tagging Effort Affects Tag Production and Human
        Signpost from the Masses:
Memory
Raluca Budiu, Peter Pirolli, Lichan Hong
Signpost from the Masses: Learning Effects in an Exploratory Social Tag Search Browser
        Learning Effects in an Exploratory
Yvonne Kammerer, Rowan Nairn, Peter Pirolli, Ed H. Chi

StudyingSocial Tag Search Browser
        Wikipedia: Wednesday, 11:30 AM - 1:00 PM
So You Know You’re Getting the Best Possible Information: A Tool that Increases Wikipedia
Credibility
Peter Pirolli, Evelin Wollny, Bongwon Rowan Nairn, Peter Pirolli, Ed H. Chi
           Yvonne Kammerer*, Suh
What's in Wikipedia? Mapping Topics and Conflict Using Socially Annotated Category
                Contact:
Structure
                Ed H. Chi, Ph.D.
Aniket Kittur, Ed H. Chi, Bongwon Suh
            Manager, Augmented Social Cognition Area
            echi@parc.com
Social Search and Sensemaking: Wednesday, 4:30 PM - 6:00 PM
Annotate Once, Appear Anywhere: Collective Foraging for Snippets of Interest Using
              Palo Alto Research Center
Paragraph Fingerprinting
Lichan Hong, Ed H. Chi
With a Little Help from My Friends: Examining Research Center, Germany
              * Intern from Knowledge Media the Impact of Social Annotations in
Sensemaking Tasks
Les Nelson, Christoph Held, Peter Pirolli, Lichan Hong, Diane Schiano, Ed H. Chi
Social Search Survey
[Brynn Evans, Ed H. Chi, CSCW2008]


     Help understand the
 
     importance of:
     –  social cues and information
        exchanges
     –  vocabulary problems
     –  distribution and
        organization




                      CHI2009 MrTaggyit now: http://mrtaggy.com
                                 Try TagSearch– © 2008 Palo Alto Research Center Inc.   2
TagSearch Exploratory Focus

                                             3 kinds of search

                      59%                                             28%                                   13%

             informational                                navigational                                      transactional
   You roughly know what you want           You know what you want and where it is                   You know what you want to do
   but don’t know how to find it




Difficult for existing search engines                                  Existing search engines are OK



             Opportunity




                                                                                                              3
                                   CHI2009 MrTaggyit now: http://mrtaggy.com
                                              Try TagSearch– © 2008 Palo Alto Research Center Inc.                             3
Research Motivation

     Social search systems:
 
     –  Search and exploration services informed by human/group
        judgments and attention data.
     –  Social bookmarks and tags is a rich source of this data.
     Key Problems:
 
     –  Coverage and participation
     –  Tag keyword ambiguity
     –  Spam and noise
                                                 –  Chris Sherman, http://searchenginewatch.com/
                                                    showPage.html?page=3623153




                   CHI2009 MrTaggyit now: http://mrtaggy.com
                              Try TagSearch– © 2008 Palo Alto Research Center Inc.                 4
Using Information Theory to Model Social Tagging
[Ed H. Chi, Todd Mytkowicz, Hypertext 2008]




                                                                                             Topics

    Concepts





                                                                                             Documents

 Users



                                                 Noise

                                                  Tags

           Decoding
                                                    Encoding

                                                 T1…Tn




                                                                                         5
                       CHI2009 MrTaggyit now: http://mrtaggy.com
                                  Try TagSearch– © 2008 Palo Alto Research Center Inc.                 5
I(Doc; Tag)

                                                                   Tags contain less
                                                             
                                                                   information about
                                                                   documents and vice
                                                                   versa over time




                                         Source: del.icio.us (Chi & Mytkowicz, Hypertext2008)


          CHI2009 MrTaggyit now: http://mrtaggy.com
                     Try TagSearch– © 2008 Palo Alto Research Center Inc.               6
Social Tagging Creates Noise



                                                               •  Synonyms
                                                               •  Misspellings
                                                               •  Morphologies

                                                               People use different
                                                               tag words to express
                                                               similar concepts.




          CHI2009 MrTaggyit now: http://mrtaggy.com
                     Try TagSearch– © 2008 Palo Alto Research Center Inc.        7
CHI2009 MrTaggyit now: http://mrtaggy.com
           Try TagSearch– © 2008 Palo Alto Research Center Inc.   8
Use Semantic Analysis to Reduce Noise


          Semantic Similarity Graph
                                         Web
                Tools
                                                             Reference

                                          Guide
            Howto

                                                         Tutorial
                                    Tips
             Help

                                                          Tutorials
                         Tip

                                       Tricks



           CHI2009 MrTaggyit now: http://mrtaggy.com
                      Try TagSearch– © 2008 Palo Alto Research Center Inc.   9
MapReduce Implementation

                       Tags                                   URLs



                                    P(URL|Tag)




                                    P(Tag|URL)


     Spreading Activation in a bigraph
   
    Computation over a very large data set
       –  150 Million+ bookmarks


               CHI2009 MrTaggyit now: http://mrtaggy.com
                          Try TagSearch– © 2008 Palo Alto Research Center Inc.   10
TagSearch
Architecture


                              Database
                                                           Lucene

• Delicious
                                           • P(URL|Tag)
                                            • Serve
up
search

                                                                                                                 results

• Ma.gnolia
                                           • P(Tag|URL)

                       • Tuples
of
                                                      • Pre‐computed

                                                                                                                • Well
defined
APIs

• Other
social
cues
                                   • Bayesian
Network

                        bookmarks
                                                        paRerns
in
a
fast

                                                        Inference
                        index

                       • [User,
URL,
Tags,

                        Time]

        Crawling
                                            MapReduce
                                              Web
Server

                                                                                                                       Web

                                                                                                                           Server





                                                                                                                  UI
                 Search

                                                                                                               Frontend
              Results

     •  MapReduce:
months
of
computaVon
to
a
single
day

     •  Development
of
novel
scoring
funcVon





                                       CHI2009 MrTaggy TagSEarch– © 2008 Palo Alto Research Center Inc.                               11
Interlude: A Word on Exploratory Search

     User lack sufficient knowledge to define the
 
     problem and search space -- ill-structured
     [Marchionini, 2006]
     Novices vs. experts
 
      –  A problem may be ill-structured for a novice;
      –  But it’s well-structured for a seasoned expert.
      –  Implication: Experts might get less benefit from an
         exploratory search system.




                    CHI2009 MrTaggyit now: http://mrtaggy.com
                               Try TagSearch– © 2008 Palo Alto Research Center Inc.   12
Baseline Interface




CHI2009 MrTaggyit now: http://mrtaggy.com
           Try TagSearch– © 2008 Palo Alto Research Center Inc.   13
Exploratory Interface




CHI2009 MrTaggyit now: http://mrtaggy.com
           Try TagSearch– © 2008 Palo Alto Research Center Inc.   14
Experiment Design
     2 interface x 3 task domain design
 
     –  2 Interface (between-subjects)
         »  Exploratory vs. Baseline
     –  3 task domains (within-subjects)
         »  Future Architecture, Global Warming, Web Mashups
     30 Subjects (22 male, 8 female)
 
     –  Intermediate or advanced computer and web search skills
     –  Half assigned Exploratory, half Baseline.
     For each domain, single block with 3 task types:
 
     –  Easy and Difficult Page Collection Task [6min each]
     –  Summarization Task [12min]
     –  Keyword Generation Task [2min]


                   CHI2009 MrTaggyit now: http://mrtaggy.com
                              Try TagSearch– © 2008 Palo Alto Research Center Inc.   15
Page Collection Tasks [6min each]




          CHI2009 MrTaggyit now: http://mrtaggy.com
                     Try TagSearch– © 2008 Palo Alto Research Center Inc.   16
Summarization Tasks [12min each]




         CHI2009 MrTaggyit now: http://mrtaggy.com
                    Try TagSearch– © 2008 Palo Alto Research Center Inc.   17
Procedure [2 hours]

   Prior Knowledge Test
 
  1st Task Domain
     –  With easy and difficult page collection tasks, summarization
        and keyword generation task.
     –  NASA cognitive load questionnaire
     2nd Task Domain
 
     –  Same battery of tasks and cognitive load questionaire
   3rd Task Domain
 
  Experimental Survey




                   CHI2009 MrTaggyit now: http://mrtaggy.com
                              Try TagSearch– © 2008 Palo Alto Research Center Inc.   18
Results: Interaction Behaviors

     Number of Queries
 
     –  Effect of Interface on number of queries (p < .01)
         »  Exploratory (M=7.81) > Baseline (M=3.77)
     Time Taken
 
     –  Effect of Interface on time taken (p < .01)
         »  Exploratory (7.7min) > Baseline (6.6min)




                    CHI2009 MrTaggyit now: http://mrtaggy.com
                               Try TagSearch– © 2008 Palo Alto Research Center Inc.   19
Results: Page Collection Task
      Measure of # of pages collected




  –  Effects of Task Domain (p<.01) and Task Difficulty (p<.05)
  –  Interaction effect of Interface by Task Domain (p<.05), with
     Exploratory interface performing better in the Web Mashup domain
  –  For relevance scores, similar patterns.

                CHI2009 MrTaggyit now: http://mrtaggy.com
                           Try TagSearch– © 2008 Palo Alto Research Center Inc.   20
Results: Summarization Tasks

                                                           –  Quality of summarization
                                                              scored (Cohen’s Kappa=0.7)
                                                           –  ANCOVA with Prior
                                                              Knowledge as covariate
                                                           –  Exploratory Interface scored
                                                              higher in Future Architecture
                                                              (p<.05) and Global Warming
                                                              (p<.05)
                                                           –  For Web Mashup, Prior
                                                              Knowledge correlated
                                                              positively with performance
                                                              (r=.51)




           CHI2009 MrTaggyit now: http://mrtaggy.com
                      Try TagSearch– © 2008 Palo Alto Research Center Inc.              21
Results: Keyword Generation Tasks

                                                                –  ANCOVA showed
                                                                   Exploratory >
                                                                   Baseline for Future
                                                                   Architecture (p<.05)
                                                                   and Web Mashups
                                                                   (p<.01), but not for
                                                                   Global Warming.
                                                                –  Linear model
                                                                   between PK and # of
                                                                   keyword generated
                                                                   for Baseline showed
                                                                   mean slope = 0.32
                                                                   and significant (p<.
                                                                   05)


           CHI2009 MrTaggyit now: http://mrtaggy.com
                      Try TagSearch– © 2008 Palo Alto Research Center Inc.                22
Results: Cognitive Load




           –  Exploratory > Baseline (p<.05)



           CHI2009 MrTaggyit now: http://mrtaggy.com
                      Try TagSearch– © 2008 Palo Alto Research Center Inc.   23
Discussion

     Exploratory interface users:
 
     –    performed more queries,
     –    took more time,
     –    wrote better summaries (in 2/3 domains),
     –    generated more relevant keywords (in 2/3 domains), and
     –    had a higher cognitive load.
   Suggestive of deeper engagement and better
 
   learning.
  Some evidence of scaffolding for novices in the
   keyword generation and summarization tasks.



                     CHI2009 MrTaggyit now: http://mrtaggy.com
                                Try TagSearch– © 2008 Palo Alto Research Center Inc.   24
Limitations

     Minimum control for domain expertise:
 
     –  Lack depth in the implication for performance.
     Pre-defined task domains:
 
     –  Lack ecological validity.




                    CHI2009 MrTaggyit now: http://mrtaggy.com
                               Try TagSearch– © 2008 Palo Alto Research Center Inc.   25
Summary
   Harnessing user-generated tags to enrich content
 
   for social search
  Weaknesses of social tagging systems is Tag
   Noise and Inconsistency
     –  Difficult to leverage for search
     –  Use data mining techniques to normalize and reduce noise
     –  Apply normalized tag data in new search algorithm
     Study suggest deeper user engagement in
 
     exploration and better learning with MrTaggy




                  CHI2009 MrTaggyit now: http://mrtaggy.com
                             Try TagSearch– © 2008 Palo Alto Research Center Inc.   26
Thanks!
  Try it now!
  http://mrtaggy.com
  http://spartag.us
  http://wikidashboard.parc.com

  Contact:
  Ed H. Chi, Ph.D.
  Manager, Augmented Social Cognition Area
  echi@parc.com

  Our Blog: http://asc-parc.blogspot.com




                CHI2009 MrTaggyit now: http://mrtaggy.com
                           Try TagSearch– © 2008 Palo Alto Research Center Inc.   27
http://wordle.net




Information Foraging: Tuesday, 9:00 AM - 10:30 AM
An Elementary Social Information Foraging Model
Peter Pirolli
Remembrance of Things Tagged: How Tagging Effort Affects Tag Production and Human Memory
Raluca Budiu, Peter Pirolli, Lichan Hong
Signpost from the Masses: Learning Effects in an Exploratory Social Tag Search Browser
Yvonne Kammerer, Rowan Nairn, Peter Pirolli, Ed H. Chi

Studying Wikipedia: Wednesday, 11:30 AM - 1:00 PM
So You Know You’re Getting the Best Possible Information: A Tool that Increases Wikipedia
Credibility
Peter Pirolli, Evelin Wollny, Bongwon Suh
What's in Wikipedia? Mapping Topics and Conflict Using Socially Annotated Category Structure
Aniket Kittur, Ed H. Chi, Bongwon Suh

Social Search and Sensemaking: Wednesday, 4:30 PM - 6:00 PM
Annotate Once, Appear Anywhere: Collective Foraging for Snippets of Interest Using Paragraph
Fingerprinting
Lichan Hong, Ed H. Chi
With a Little Help from My Friends: Examining the Impact of Social Annotations in Sensemaking
Tasks
Les Nelson, Christoph Held, Peter Pirolli, Lichan Hong, Diane Schiano, Ed H. Chi
Cognition:
the
ability
to
remember,
think,
and
reason;
the
faculty
of

 

     knowing.

     Social
Cognition:
the
ability
of
a
group
to
remember,
think,
and

 

     reason;
the
construction
of
knowledge
structures
by
a
group.

      –  (not
quite
the
same
as
in
the
branch
of
psychology
that
studies
the

         cognitive
processes
involved
in
social
interaction,
though
included)

     Augmented
Social
Cognition:
Supported
by
systems,
the

 

     enhancement

of
the
ability
of
a
group
to
remember,
think,
and

     reason;
the
system‐supported
construction
of
knowledge

     structures
by
a
group.



Citation:
Ed
H.
Chi.
The
Social
Web:
Opportunities
for
Research.

IEEE
Computer,
Sept
2008





 2008-11-07                           Ed H. Chi ASC Overview                                  29
Social Transparency create
                                                                                          trust and attribution:
                                                                                           •  Increase participation via
                                                                                              attribution
  Collective Intelligence
                                                                 •  Increase credibility and trust
                                                                                              with community feedback
                                                                                           •  Reduce wiki risks
                                TagSearch: Mining social
                                data for automatic data
                                clustering and organization:
                                 •  Better organization via user-
                                    assigned tags
Higher Productivity via          •  Better UI for browsing
                                                                              sharing
            Generic benefits:
                                    interesting contents
Collective Intelligence                                                                           •  Greater trust
                                 •  Recommendation instead of
                                                                                                  •  Better decision-making
                                    just search
Intelligence that emerges                                                                         •  Useful sharing of info
                                                                                                  •  Auto-organization thru
from the collaboration and                                          search
                          social data
competition of many
                                                                                   foraging
individuals

Foundation:
                                                                                               SparTag.us: sharing of
•  Understanding of human
                                                                                               interesting contents:
   cognition and behavior                                                                       •  A notebook that automatically
•  Data mining of social data                                                                      organizes your reading
                                                                                                •  Social sharing of important
                                                                                                   and interesting tidbits
                                                                                                •  Viral sharing of highlighted
                                                                                                   and tagged paragraphs


                                                                                                                     30

More Related Content

Viewers also liked

la belleza de los numeros
la belleza de los numerosla belleza de los numeros
la belleza de los numerosvredondof
 
Horario Joyeria Calvo
Horario Joyeria CalvoHorario Joyeria Calvo
Horario Joyeria Calvovredondof
 
Bmw serie-5-touring-fe-abr-10
Bmw serie-5-touring-fe-abr-10Bmw serie-5-touring-fe-abr-10
Bmw serie-5-touring-fe-abr-10vredondof
 
Horario Unicef2007
Horario Unicef2007Horario Unicef2007
Horario Unicef2007vredondof
 
Clasificacion Joyeria Calvo2007
Clasificacion Joyeria Calvo2007Clasificacion Joyeria Calvo2007
Clasificacion Joyeria Calvo2007vredondof
 
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...Ed Chi
 
ASC Disaster Response Proposal from Aug 2007
ASC Disaster Response Proposal from Aug 2007ASC Disaster Response Proposal from Aug 2007
ASC Disaster Response Proposal from Aug 2007Ed Chi
 
CIKM 2011 Social Computing Industry Invited Talk
CIKM 2011 Social Computing Industry Invited TalkCIKM 2011 Social Computing Industry Invited Talk
CIKM 2011 Social Computing Industry Invited TalkEd Chi
 
The Microkernel Mach Under NeXTSTEP
The Microkernel Mach Under NeXTSTEPThe Microkernel Mach Under NeXTSTEP
The Microkernel Mach Under NeXTSTEPGregor Schmidt
 

Viewers also liked (11)

la belleza de los numeros
la belleza de los numerosla belleza de los numeros
la belleza de los numeros
 
Literate Maruku
Literate MarukuLiterate Maruku
Literate Maruku
 
Horario Joyeria Calvo
Horario Joyeria CalvoHorario Joyeria Calvo
Horario Joyeria Calvo
 
Bmw serie-5-touring-fe-abr-10
Bmw serie-5-touring-fe-abr-10Bmw serie-5-touring-fe-abr-10
Bmw serie-5-touring-fe-abr-10
 
Horario Unicef2007
Horario Unicef2007Horario Unicef2007
Horario Unicef2007
 
Clasificacion Joyeria Calvo2007
Clasificacion Joyeria Calvo2007Clasificacion Joyeria Calvo2007
Clasificacion Joyeria Calvo2007
 
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...
Slowing Growth of Wikipedia and Models of its Dynamic (Presented at Wikimedia...
 
ASC Disaster Response Proposal from Aug 2007
ASC Disaster Response Proposal from Aug 2007ASC Disaster Response Proposal from Aug 2007
ASC Disaster Response Proposal from Aug 2007
 
Camping
CampingCamping
Camping
 
CIKM 2011 Social Computing Industry Invited Talk
CIKM 2011 Social Computing Industry Invited TalkCIKM 2011 Social Computing Industry Invited Talk
CIKM 2011 Social Computing Industry Invited Talk
 
The Microkernel Mach Under NeXTSTEP
The Microkernel Mach Under NeXTSTEPThe Microkernel Mach Under NeXTSTEP
The Microkernel Mach Under NeXTSTEP
 

Similar to CHI2009 MrTaggy Tag-based Search Browser Intro and Evaluation

2007 KMWorld Presentation on Augmented Social Cognition Research at PARC
2007 KMWorld Presentation on Augmented Social Cognition Research at PARC2007 KMWorld Presentation on Augmented Social Cognition Research at PARC
2007 KMWorld Presentation on Augmented Social Cognition Research at PARCEd Chi
 
Enhancing the Social Web through Augmented Social Cognition Research
Enhancing the Social Web through Augmented Social Cognition ResearchEnhancing the Social Web through Augmented Social Cognition Research
Enhancing the Social Web through Augmented Social Cognition ResearchEd Chi
 
Search Analytics Business Value & NoSQL Backend
Search Analytics Business Value & NoSQL BackendSearch Analytics Business Value & NoSQL Backend
Search Analytics Business Value & NoSQL BackendSematext Group, Inc.
 
Online Community Best Practices Final
Online Community Best Practices FinalOnline Community Best Practices Final
Online Community Best Practices FinalRoger Pilney
 
Understanding Research 2.0 from a Socio-technical Perspective
Understanding Research 2.0 from a Socio-technical PerspectiveUnderstanding Research 2.0 from a Socio-technical Perspective
Understanding Research 2.0 from a Socio-technical PerspectiveYuwei Lin
 
ReSearch - Searching for Researchers
ReSearch - Searching for ResearchersReSearch - Searching for Researchers
ReSearch - Searching for ResearchersDavide Eynard
 
Semantic Solutions from Information Exploration.pptx
Semantic Solutions from Information Exploration.pptxSemantic Solutions from Information Exploration.pptx
Semantic Solutions from Information Exploration.pptxInformation Exploration
 
Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)tiptoptech
 
Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)tiptoptech
 
Why we love metadata
Why we love metadataWhy we love metadata
Why we love metadataChris Jackson
 
CansecWest2019: Infosec Frameworks for Misinformation
CansecWest2019: Infosec Frameworks for MisinformationCansecWest2019: Infosec Frameworks for Misinformation
CansecWest2019: Infosec Frameworks for Misinformationbodaceacat
 
Terp breuer misinfosecframeworks_cansecwest2019
Terp breuer misinfosecframeworks_cansecwest2019Terp breuer misinfosecframeworks_cansecwest2019
Terp breuer misinfosecframeworks_cansecwest2019bodaceacat
 
Misinfosec frameworks Cansecwest 2019
Misinfosec frameworks Cansecwest 2019Misinfosec frameworks Cansecwest 2019
Misinfosec frameworks Cansecwest 2019bodaceacat
 
Connecting The Play of Improv with The Work of Ethnographic Research
Connecting The Play of Improv with The Work of Ethnographic Research Connecting The Play of Improv with The Work of Ethnographic Research
Connecting The Play of Improv with The Work of Ethnographic Research Steve Portigal
 
ASC Research given at the PARC Forum on 2008-05-01
ASC Research given at the PARC Forum on 2008-05-01ASC Research given at the PARC Forum on 2008-05-01
ASC Research given at the PARC Forum on 2008-05-01Ed Chi
 
Extracting Semantics from Crowds
Extracting Semantics from CrowdsExtracting Semantics from Crowds
Extracting Semantics from CrowdsMarkus Strohmaier
 

Similar to CHI2009 MrTaggy Tag-based Search Browser Intro and Evaluation (20)

2007 KMWorld Presentation on Augmented Social Cognition Research at PARC
2007 KMWorld Presentation on Augmented Social Cognition Research at PARC2007 KMWorld Presentation on Augmented Social Cognition Research at PARC
2007 KMWorld Presentation on Augmented Social Cognition Research at PARC
 
Enhancing the Social Web through Augmented Social Cognition Research
Enhancing the Social Web through Augmented Social Cognition ResearchEnhancing the Social Web through Augmented Social Cognition Research
Enhancing the Social Web through Augmented Social Cognition Research
 
Search Analytics Business Value & NoSQL Backend
Search Analytics Business Value & NoSQL BackendSearch Analytics Business Value & NoSQL Backend
Search Analytics Business Value & NoSQL Backend
 
Minixsmp
MinixsmpMinixsmp
Minixsmp
 
Sample Comic Scene
Sample Comic SceneSample Comic Scene
Sample Comic Scene
 
Google Machine Learning Algorithms and SEO
Google Machine Learning Algorithms and SEOGoogle Machine Learning Algorithms and SEO
Google Machine Learning Algorithms and SEO
 
Online Community Best Practices Final
Online Community Best Practices FinalOnline Community Best Practices Final
Online Community Best Practices Final
 
Understanding Research 2.0 from a Socio-technical Perspective
Understanding Research 2.0 from a Socio-technical PerspectiveUnderstanding Research 2.0 from a Socio-technical Perspective
Understanding Research 2.0 from a Socio-technical Perspective
 
ReSearch - Searching for Researchers
ReSearch - Searching for ResearchersReSearch - Searching for Researchers
ReSearch - Searching for Researchers
 
Online Strategic Planning
Online Strategic PlanningOnline Strategic Planning
Online Strategic Planning
 
Semantic Solutions from Information Exploration.pptx
Semantic Solutions from Information Exploration.pptxSemantic Solutions from Information Exploration.pptx
Semantic Solutions from Information Exploration.pptx
 
Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)
 
Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)Meaning of life (TipTop Technologies)
Meaning of life (TipTop Technologies)
 
Why we love metadata
Why we love metadataWhy we love metadata
Why we love metadata
 
CansecWest2019: Infosec Frameworks for Misinformation
CansecWest2019: Infosec Frameworks for MisinformationCansecWest2019: Infosec Frameworks for Misinformation
CansecWest2019: Infosec Frameworks for Misinformation
 
Terp breuer misinfosecframeworks_cansecwest2019
Terp breuer misinfosecframeworks_cansecwest2019Terp breuer misinfosecframeworks_cansecwest2019
Terp breuer misinfosecframeworks_cansecwest2019
 
Misinfosec frameworks Cansecwest 2019
Misinfosec frameworks Cansecwest 2019Misinfosec frameworks Cansecwest 2019
Misinfosec frameworks Cansecwest 2019
 
Connecting The Play of Improv with The Work of Ethnographic Research
Connecting The Play of Improv with The Work of Ethnographic Research Connecting The Play of Improv with The Work of Ethnographic Research
Connecting The Play of Improv with The Work of Ethnographic Research
 
ASC Research given at the PARC Forum on 2008-05-01
ASC Research given at the PARC Forum on 2008-05-01ASC Research given at the PARC Forum on 2008-05-01
ASC Research given at the PARC Forum on 2008-05-01
 
Extracting Semantics from Crowds
Extracting Semantics from CrowdsExtracting Semantics from Crowds
Extracting Semantics from Crowds
 

More from Ed Chi

2017 10-10 (netflix ml platform meetup) learning item and user representation...
2017 10-10 (netflix ml platform meetup) learning item and user representation...2017 10-10 (netflix ml platform meetup) learning item and user representation...
2017 10-10 (netflix ml platform meetup) learning item and user representation...Ed Chi
 
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social Computing
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social ComputingHCI Korea 2012 Keynote Talk on Model-Driven Research in Social Computing
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social ComputingEd Chi
 
Location and Language in Social Media (Stanford Mobi Social Invited Talk)
Location and Language in Social Media (Stanford Mobi Social Invited Talk)Location and Language in Social Media (Stanford Mobi Social Invited Talk)
Location and Language in Social Media (Stanford Mobi Social Invited Talk)Ed Chi
 
Crowdsourcing using MTurk for HCI research
Crowdsourcing using MTurk for HCI researchCrowdsourcing using MTurk for HCI research
Crowdsourcing using MTurk for HCI researchEd Chi
 
WikiSym 2011 Closing Keynote
WikiSym 2011 Closing KeynoteWikiSym 2011 Closing Keynote
WikiSym 2011 Closing KeynoteEd Chi
 
CSCL 2011 Keynote on Social Computing and eLearning
CSCL 2011 Keynote on Social Computing and eLearningCSCL 2011 Keynote on Social Computing and eLearning
CSCL 2011 Keynote on Social Computing and eLearningEd Chi
 
Replication is more than Duplication: Position slides for CHI2011 panel on re...
Replication is more than Duplication: Position slides for CHI2011 panel on re...Replication is more than Duplication: Position slides for CHI2011 panel on re...
Replication is more than Duplication: Position slides for CHI2011 panel on re...Ed Chi
 
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchTutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchEd Chi
 
Crowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical TurkCrowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical TurkEd Chi
 
Eddi: Topic Browsing of Twitter Streams
Eddi: Topic Browsing of Twitter StreamsEddi: Topic Browsing of Twitter Streams
Eddi: Topic Browsing of Twitter StreamsEd Chi
 
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...Ed Chi
 
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...Ed Chi
 
Zerozero88 Twitter URL Item Recommender
Zerozero88 Twitter URL Item RecommenderZerozero88 Twitter URL Item Recommender
Zerozero88 Twitter URL Item RecommenderEd Chi
 
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006Ed Chi
 
Model-Driven Research in Social Computing
Model-Driven Research in Social ComputingModel-Driven Research in Social Computing
Model-Driven Research in Social ComputingEd Chi
 
Using Information Scent to Model Users in Web1.0 and Web2.0
Using Information Scent to Model Users in Web1.0 and Web2.0Using Information Scent to Model Users in Web1.0 and Web2.0
Using Information Scent to Model Users in Web1.0 and Web2.0Ed Chi
 
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...Ed Chi
 
2010-03-10 PARC Augmented Social Cognition Research Overview
2010-03-10 PARC Augmented Social Cognition Research Overview2010-03-10 PARC Augmented Social Cognition Research Overview
2010-03-10 PARC Augmented Social Cognition Research OverviewEd Chi
 
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica SinicaEd Chi
 
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...Ed Chi
 

More from Ed Chi (20)

2017 10-10 (netflix ml platform meetup) learning item and user representation...
2017 10-10 (netflix ml platform meetup) learning item and user representation...2017 10-10 (netflix ml platform meetup) learning item and user representation...
2017 10-10 (netflix ml platform meetup) learning item and user representation...
 
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social Computing
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social ComputingHCI Korea 2012 Keynote Talk on Model-Driven Research in Social Computing
HCI Korea 2012 Keynote Talk on Model-Driven Research in Social Computing
 
Location and Language in Social Media (Stanford Mobi Social Invited Talk)
Location and Language in Social Media (Stanford Mobi Social Invited Talk)Location and Language in Social Media (Stanford Mobi Social Invited Talk)
Location and Language in Social Media (Stanford Mobi Social Invited Talk)
 
Crowdsourcing using MTurk for HCI research
Crowdsourcing using MTurk for HCI researchCrowdsourcing using MTurk for HCI research
Crowdsourcing using MTurk for HCI research
 
WikiSym 2011 Closing Keynote
WikiSym 2011 Closing KeynoteWikiSym 2011 Closing Keynote
WikiSym 2011 Closing Keynote
 
CSCL 2011 Keynote on Social Computing and eLearning
CSCL 2011 Keynote on Social Computing and eLearningCSCL 2011 Keynote on Social Computing and eLearning
CSCL 2011 Keynote on Social Computing and eLearning
 
Replication is more than Duplication: Position slides for CHI2011 panel on re...
Replication is more than Duplication: Position slides for CHI2011 panel on re...Replication is more than Duplication: Position slides for CHI2011 panel on re...
Replication is more than Duplication: Position slides for CHI2011 panel on re...
 
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchTutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
 
Crowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical TurkCrowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical Turk
 
Eddi: Topic Browsing of Twitter Streams
Eddi: Topic Browsing of Twitter StreamsEddi: Topic Browsing of Twitter Streams
Eddi: Topic Browsing of Twitter Streams
 
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...
Large Scale Social Analytics on Wikipedia, Delicious, and Twitter (presented ...
 
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...
Model-based Research in Human-Computer Interaction (HCI): Keynote at Mensch u...
 
Zerozero88 Twitter URL Item Recommender
Zerozero88 Twitter URL Item RecommenderZerozero88 Twitter URL Item Recommender
Zerozero88 Twitter URL Item Recommender
 
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006
Smart eBooks: ScentIndex and ScentHighlight research published at VAST2006
 
Model-Driven Research in Social Computing
Model-Driven Research in Social ComputingModel-Driven Research in Social Computing
Model-Driven Research in Social Computing
 
Using Information Scent to Model Users in Web1.0 and Web2.0
Using Information Scent to Model Users in Web1.0 and Web2.0Using Information Scent to Model Users in Web1.0 and Web2.0
Using Information Scent to Model Users in Web1.0 and Web2.0
 
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...
China HCI Symposium 2010 March: Augmented Social Cognition Research from PARC...
 
2010-03-10 PARC Augmented Social Cognition Research Overview
2010-03-10 PARC Augmented Social Cognition Research Overview2010-03-10 PARC Augmented Social Cognition Research Overview
2010-03-10 PARC Augmented Social Cognition Research Overview
 
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica
2010-02-22 Wikipedia MTurk Research talk given in Taiwan's Academica Sinica
 
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
 

Recently uploaded

A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxAna-Maria Mihalceanu
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfROWELL MARQUINA
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessWSO2
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsYoss Cohen
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Karmanjay Verma
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfAarwolf Industries LLC
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Nikki Chapple
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialJoão Esperancinha
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 

Recently uploaded (20)

A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance Toolbox
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDF
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdf
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with Platformless
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platforms
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
How Tech Giants Cut Corners to Harvest Data for A.I.
How Tech Giants Cut Corners to Harvest Data for A.I.How Tech Giants Cut Corners to Harvest Data for A.I.
How Tech Giants Cut Corners to Harvest Data for A.I.
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorial
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 

CHI2009 MrTaggy Tag-based Search Browser Intro and Evaluation

  • 1. Information Foraging: Tuesday, 9:00 AM - 10:30 AM An Elementary Social Information Foraging Model Peter Pirolli Remembrance of Things Tagged: How Tagging Effort Affects Tag Production and Human Signpost from the Masses: Memory Raluca Budiu, Peter Pirolli, Lichan Hong Signpost from the Masses: Learning Effects in an Exploratory Social Tag Search Browser Learning Effects in an Exploratory Yvonne Kammerer, Rowan Nairn, Peter Pirolli, Ed H. Chi StudyingSocial Tag Search Browser Wikipedia: Wednesday, 11:30 AM - 1:00 PM So You Know You’re Getting the Best Possible Information: A Tool that Increases Wikipedia Credibility Peter Pirolli, Evelin Wollny, Bongwon Rowan Nairn, Peter Pirolli, Ed H. Chi Yvonne Kammerer*, Suh What's in Wikipedia? Mapping Topics and Conflict Using Socially Annotated Category Contact: Structure Ed H. Chi, Ph.D. Aniket Kittur, Ed H. Chi, Bongwon Suh Manager, Augmented Social Cognition Area echi@parc.com Social Search and Sensemaking: Wednesday, 4:30 PM - 6:00 PM Annotate Once, Appear Anywhere: Collective Foraging for Snippets of Interest Using Palo Alto Research Center Paragraph Fingerprinting Lichan Hong, Ed H. Chi With a Little Help from My Friends: Examining Research Center, Germany * Intern from Knowledge Media the Impact of Social Annotations in Sensemaking Tasks Les Nelson, Christoph Held, Peter Pirolli, Lichan Hong, Diane Schiano, Ed H. Chi
  • 2. Social Search Survey [Brynn Evans, Ed H. Chi, CSCW2008] Help understand the   importance of: –  social cues and information exchanges –  vocabulary problems –  distribution and organization CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 2
  • 3. TagSearch Exploratory Focus 3 kinds of search 59% 28% 13% informational navigational transactional You roughly know what you want You know what you want and where it is You know what you want to do but don’t know how to find it Difficult for existing search engines Existing search engines are OK Opportunity 3 CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 3
  • 4. Research Motivation Social search systems:   –  Search and exploration services informed by human/group judgments and attention data. –  Social bookmarks and tags is a rich source of this data. Key Problems:   –  Coverage and participation –  Tag keyword ambiguity –  Spam and noise –  Chris Sherman, http://searchenginewatch.com/ showPage.html?page=3623153 CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 4
  • 5. Using Information Theory to Model Social Tagging [Ed H. Chi, Todd Mytkowicz, Hypertext 2008] Topics
 Concepts
 Documents
 Users
 Noise
 Tags
 Decoding
 Encoding
 T1…Tn
 5 CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 5
  • 6. I(Doc; Tag) Tags contain less   information about documents and vice versa over time Source: del.icio.us (Chi & Mytkowicz, Hypertext2008) CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 6
  • 7. Social Tagging Creates Noise •  Synonyms •  Misspellings •  Morphologies People use different tag words to express similar concepts. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 7
  • 8. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 8
  • 9. Use Semantic Analysis to Reduce Noise Semantic Similarity Graph Web Tools Reference Guide Howto Tutorial Tips Help Tutorials Tip Tricks CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 9
  • 10. MapReduce Implementation Tags URLs P(URL|Tag) P(Tag|URL) Spreading Activation in a bigraph     Computation over a very large data set –  150 Million+ bookmarks CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 10
  • 11. TagSearch
Architecture
 Database
 Lucene
 • Delicious
 • P(URL|Tag)
 • Serve
up
search
 results
 • Ma.gnolia
 • P(Tag|URL)
 • Tuples
of
 • Pre‐computed
 • Well
defined
APIs
 • Other
social
cues
 • Bayesian
Network
 bookmarks
 paRerns
in
a
fast
 Inference
 index
 • [User,
URL,
Tags,
 Time]
 Crawling
 MapReduce
 Web
Server
 Web
 Server
 UI
 Search
 Frontend
 Results
 •  MapReduce:
months
of
computaVon
to
a
single
day
 •  Development
of
novel
scoring
funcVon

 CHI2009 MrTaggy TagSEarch– © 2008 Palo Alto Research Center Inc. 11
  • 12. Interlude: A Word on Exploratory Search User lack sufficient knowledge to define the   problem and search space -- ill-structured [Marchionini, 2006] Novices vs. experts   –  A problem may be ill-structured for a novice; –  But it’s well-structured for a seasoned expert. –  Implication: Experts might get less benefit from an exploratory search system. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 12
  • 13. Baseline Interface CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 13
  • 14. Exploratory Interface CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 14
  • 15. Experiment Design 2 interface x 3 task domain design   –  2 Interface (between-subjects) »  Exploratory vs. Baseline –  3 task domains (within-subjects) »  Future Architecture, Global Warming, Web Mashups 30 Subjects (22 male, 8 female)   –  Intermediate or advanced computer and web search skills –  Half assigned Exploratory, half Baseline. For each domain, single block with 3 task types:   –  Easy and Difficult Page Collection Task [6min each] –  Summarization Task [12min] –  Keyword Generation Task [2min] CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 15
  • 16. Page Collection Tasks [6min each] CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 16
  • 17. Summarization Tasks [12min each] CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 17
  • 18. Procedure [2 hours] Prior Knowledge Test     1st Task Domain –  With easy and difficult page collection tasks, summarization and keyword generation task. –  NASA cognitive load questionnaire 2nd Task Domain   –  Same battery of tasks and cognitive load questionaire 3rd Task Domain     Experimental Survey CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 18
  • 19. Results: Interaction Behaviors Number of Queries   –  Effect of Interface on number of queries (p < .01) »  Exploratory (M=7.81) > Baseline (M=3.77) Time Taken   –  Effect of Interface on time taken (p < .01) »  Exploratory (7.7min) > Baseline (6.6min) CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 19
  • 20. Results: Page Collection Task Measure of # of pages collected –  Effects of Task Domain (p<.01) and Task Difficulty (p<.05) –  Interaction effect of Interface by Task Domain (p<.05), with Exploratory interface performing better in the Web Mashup domain –  For relevance scores, similar patterns. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 20
  • 21. Results: Summarization Tasks –  Quality of summarization scored (Cohen’s Kappa=0.7) –  ANCOVA with Prior Knowledge as covariate –  Exploratory Interface scored higher in Future Architecture (p<.05) and Global Warming (p<.05) –  For Web Mashup, Prior Knowledge correlated positively with performance (r=.51) CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 21
  • 22. Results: Keyword Generation Tasks –  ANCOVA showed Exploratory > Baseline for Future Architecture (p<.05) and Web Mashups (p<.01), but not for Global Warming. –  Linear model between PK and # of keyword generated for Baseline showed mean slope = 0.32 and significant (p<. 05) CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 22
  • 23. Results: Cognitive Load –  Exploratory > Baseline (p<.05) CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 23
  • 24. Discussion Exploratory interface users:   –  performed more queries, –  took more time, –  wrote better summaries (in 2/3 domains), –  generated more relevant keywords (in 2/3 domains), and –  had a higher cognitive load. Suggestive of deeper engagement and better   learning.   Some evidence of scaffolding for novices in the keyword generation and summarization tasks. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 24
  • 25. Limitations Minimum control for domain expertise:   –  Lack depth in the implication for performance. Pre-defined task domains:   –  Lack ecological validity. CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 25
  • 26. Summary Harnessing user-generated tags to enrich content   for social search   Weaknesses of social tagging systems is Tag Noise and Inconsistency –  Difficult to leverage for search –  Use data mining techniques to normalize and reduce noise –  Apply normalized tag data in new search algorithm Study suggest deeper user engagement in   exploration and better learning with MrTaggy CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 26
  • 27. Thanks! Try it now! http://mrtaggy.com http://spartag.us http://wikidashboard.parc.com Contact: Ed H. Chi, Ph.D. Manager, Augmented Social Cognition Area echi@parc.com Our Blog: http://asc-parc.blogspot.com CHI2009 MrTaggyit now: http://mrtaggy.com Try TagSearch– © 2008 Palo Alto Research Center Inc. 27
  • 28. http://wordle.net Information Foraging: Tuesday, 9:00 AM - 10:30 AM An Elementary Social Information Foraging Model Peter Pirolli Remembrance of Things Tagged: How Tagging Effort Affects Tag Production and Human Memory Raluca Budiu, Peter Pirolli, Lichan Hong Signpost from the Masses: Learning Effects in an Exploratory Social Tag Search Browser Yvonne Kammerer, Rowan Nairn, Peter Pirolli, Ed H. Chi Studying Wikipedia: Wednesday, 11:30 AM - 1:00 PM So You Know You’re Getting the Best Possible Information: A Tool that Increases Wikipedia Credibility Peter Pirolli, Evelin Wollny, Bongwon Suh What's in Wikipedia? Mapping Topics and Conflict Using Socially Annotated Category Structure Aniket Kittur, Ed H. Chi, Bongwon Suh Social Search and Sensemaking: Wednesday, 4:30 PM - 6:00 PM Annotate Once, Appear Anywhere: Collective Foraging for Snippets of Interest Using Paragraph Fingerprinting Lichan Hong, Ed H. Chi With a Little Help from My Friends: Examining the Impact of Social Annotations in Sensemaking Tasks Les Nelson, Christoph Held, Peter Pirolli, Lichan Hong, Diane Schiano, Ed H. Chi
  • 29. Cognition:
the
ability
to
remember,
think,
and
reason;
the
faculty
of
   knowing.
 Social
Cognition:
the
ability
of
a
group
to
remember,
think,
and
   reason;
the
construction
of
knowledge
structures
by
a
group.
 –  (not
quite
the
same
as
in
the
branch
of
psychology
that
studies
the
 cognitive
processes
involved
in
social
interaction,
though
included)
 Augmented
Social
Cognition:
Supported
by
systems,
the
   enhancement

of
the
ability
of
a
group
to
remember,
think,
and
 reason;
the
system‐supported
construction
of
knowledge
 structures
by
a
group.

 Citation:
Ed
H.
Chi.
The
Social
Web:
Opportunities
for
Research.

IEEE
Computer,
Sept
2008
 2008-11-07 Ed H. Chi ASC Overview 29
  • 30. Social Transparency create trust and attribution: •  Increase participation via attribution Collective Intelligence •  Increase credibility and trust with community feedback •  Reduce wiki risks TagSearch: Mining social data for automatic data clustering and organization: •  Better organization via user- assigned tags Higher Productivity via •  Better UI for browsing sharing Generic benefits: interesting contents Collective Intelligence •  Greater trust •  Recommendation instead of •  Better decision-making just search Intelligence that emerges •  Useful sharing of info •  Auto-organization thru from the collaboration and search social data competition of many foraging individuals Foundation: SparTag.us: sharing of •  Understanding of human interesting contents: cognition and behavior •  A notebook that automatically •  Data mining of social data organizes your reading •  Social sharing of important and interesting tidbits •  Viral sharing of highlighted and tagged paragraphs 30