An Introduce to Topic Model

1,598
-1

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,598
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
25
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

An Introduce to Topic Model

  1. 1. An Introduce to Topic Model towards a topical social dynamics Mingli Yuan 2012-11-12Monday, November 12, 12
  2. 2. Contents • Part one: Probabilistic topic modeling • Part two: Towards a topical social dynamics • Last question: How about ontological social dynamics?Monday, November 12, 12
  3. 3. Probabilistic topic model credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  4. 4. Latent Dirichlet Allocation credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  5. 5. Topic model family credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  6. 6. Dynamic topic model credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  7. 7. Hierarchical Dirichlet Process credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  8. 8. Online demo • Allison Chaney: Topic Model Visualization Engine (TMVE) • lda for The American Political Science Review • lda for 2006 arXiv • ctm for Science (1980-2000) • dtm for Science (1882-2001)Monday, November 12, 12
  9. 9. Research groups • David M. Blei and others from Princeton University • http://www.cs.princeton.edu/~blei/ topicmodeling.html • Wei Li, Wang Xuerui and Andrew McCallum from University of Massachusetts • http://people.cs.umass.edu/~mccallum/ • ......Monday, November 12, 12
  10. 10. Implementations • lda-c and others • http://www.cs.princeton.edu/~blei/ topicmodeling.html • gensim • http://radimrehurek.com/gensim/ • mallet • http://mallet.cs.umass.edu/index.phpMonday, November 12, 12
  11. 11. Interactions on SNS Structure: • following relationship Interaction: • notification by @ • reply • retweet Credit by Kencf0618 http://commons.wikimedia.org/wiki/File:Kencf0618FacebookNetwork.jpgMonday, November 12, 12
  12. 12. Spreading and conversation Conversation by reply by Roger McLassus http://commons.wikimedia.org/wiki/File:2006-01-14_Surface_waves.jpg Spreading by retweet The Convesation by Arnold Lakhovsky http://commons.wikimedia.org/wiki/File:Lakhovsky_Conversation.jpgMonday, November 12, 12
  13. 13. Conversation graph • Conversation graph: • the graph draw by reply relationship • One tweet is too small and very contextual • Conversation graph can be treat as a basic unit for study • Inside conversation-graph • Inter conversation-graphMonday, November 12, 12
  14. 14. Applying topic model • Rational topic model for the inner- structure of the conversation-graph credit images from probabilistic topic model by D.M. Blei 2012 http://www.cs.princeton.edu/~blei/kdd-tutorial.pdfMonday, November 12, 12
  15. 15. The needs of topical social dynamics • How about the inter-structure of conversation- graph? • we need a new tool - the topical social dynamics • theory not available right now • Topic model are already here • Graph dynamical system are emerging • slowness: lda is slow, dtm is very slow, ....Monday, November 12, 12
  16. 16. The last question • How about ontological social dynamics? • Topic is too coarse-grained • ontological-social data are not very abundant today • knowledge is likely to be expressed by natural language, not the ontology • But .... • in promising futureMonday, November 12, 12

×