MTSW-Twitter-1

573 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
573
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • lean and mean 기를 쓰고, 눈에 불을 밝히고,\n
  • \n
  • \n
  • \n
  • secret_code\n
  • 호출당 5,000명\n350*5,000 = 1,750,000\n이전화면에서 user id는 처음이 최초 폴로잉, 마지막이 처음 폴로잉.\n
  • \n
  • \n
  • 스트링,해쉬,리스트,셋을 키로 가질 수 있다.\n
  • \n
  • scard - 멤버수\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • 두명의 유저가 많은 수의 동일한 사람들을 폴로잉하고 있다면 그 사람 두명은 유사한 관심 사항이 있을 것이다.\n
  • 공통의 친구와 폴로워 계산을 교집합을 통해 수행한다.\nscard - 멤버 수.\n
  • 공통의 친구와 폴로워 계산을 교집합을 통해 수행한다.\nscard - 멤버 수.\n
  • 단순한 방법은 폴로워 수가 많은 사람.\n
  • 가장 단순한 측정 방법은 자신의 폴로워중 폴로워수가 많은 사람.\neasy_install prettytable\n
  • 폴로워의 친구/폴로워 수를 수집하여 redis에 저장한다.\ndepth =1\n
  • 저장된 친구/폴로우에서 가장 높은 순으로 출력한다.\n
  • 상위 10명을 제외하면 284,\n하위 10명을 제외하면 1000\n
  • \n
  • 트윗분석을 할 때 큰 클리크에서 트윗의 유사성과 다양성을 분석하는 것은 효율적이다.\n
  • 클리크를 찾는 방법은 매우 어렵지만 NetworkX에서 find_cliques를 지원한다.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • MTSW-Twitter-1

    1. 1. Twitter:Friends, Followers, andSet wise Operations
    2. 2. How many friends/followers do I have?Who am I following that is not following meback?Who is following me that I am not followingback?Who are the friendliest and least friendly peoplein my net work?Who are my "mutual friends"?Given all of my followers and all of theirfollowers, what is my potential influence if I getret weeted?
    3. 3. Twitters RESTful API
    4. 4. /users/show
    5. 5. OAuth
    6. 6. A Lean, Mean Data-Collection Machine401(Not Authorized), 503(OverCapacity) Errort witter module throwsTwitterHTTPErrorUse try/except block
    7. 7. Registering an app at http://dev.t witter.com/apps/newfriend/follower data will return up to5,000IDs per callUsers could retrieve up to 1,750,000 Idsbefore rate limiting.(350 request/hour)ID values seem to be in reversechronological order(the first->mostrecently followed, the last-> the firstperson you followed)
    8. 8. How to navigate IDs
    9. 9. Store/Retrieve OAuth tokenread_token_filewrite_token_file
    10. 10. Redis : A Data Structures Serverkey-value storeData structure ser ver that keys cancontain strings, hashes, lists, sets andsorted sets.make V=1sudo make installeasy_install redisredis-server
    11. 11. Redis : A Data Structures Serverkey-value storeData structure ser ver that keys cancontain strings, hashes, lists, sets andsorted sets.make V=1sudo make installeasy_install redisredis-server
    12. 12. Set Operations
    13. 13. Redis command
    14. 14. Souping Up the Machine with Basic Friend/ Follower Metrics
    15. 15. Who isntfollowing me back?following -> 663 < 100*7follower -> 1,423,704 < 100*350*41Randomly sample and calculatemeasures of statistical significance ->srandmember
    16. 16. Calculating Similarity Computing common friends and followers is just set operation away. Use a set intersection -> sinterstore
    17. 17. EX 4-5
    18. 18. EX 4-5
    19. 19. EX 4-5
    20. 20. Measuring InfluenceOne trivial way to measure the relativeinfluence of t wo or more users is tosimply compare their number offollowers.MAVENS - well connected and like toshare information.
    21. 21. Measuring Influence
    22. 22. Remove top 10 followers -> avg : 284Remove less than 10 followers -> 1,000
    23. 23. Construction Friendship Graphs
    24. 24. Clique Detection and AnalysisAn analysis of the similarity/diversityof t weet content among members of alarge clique would be a very worthy int weet analysis
    25. 25. The Infochimps"Strong Links" API
    26. 26. 3D Graph Visualization

    ×