Published on

Published in: Technology, Design
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. Blog search engine
  2. 2. Agenda Technorati Site Guide Search Engine Blog Micro Blog RSS Feed Technorati Tagging Bookmarking
  3. 3. <ul><ul><li>Introduction </li></ul></ul><ul><ul><li>Home Page </li></ul></ul><ul><ul><li>How to Join ? </li></ul></ul><ul><ul><li>How to claim you Blog? </li></ul></ul><ul><ul><li>Blog Directory </li></ul></ul><ul><ul><li>How to add Favorite Blog ? </li></ul></ul><ul><ul><li>How to add WatchList? </li></ul></ul><ul><ul><li>How to Ping your Blogs? </li></ul></ul><ul><ul><li>Technorati Charts, widgets </li></ul></ul><ul><ul><li>Twittorati </li></ul></ul><ul><ul><li>Blogsphere </li></ul></ul>Technorati Site Guide
  4. 4. <ul><li>Technorati was founded to help bloggers succeed by collecting, highlighting, and distributing the global online conversation. </li></ul>David L. Sifry Founder and Chairman
  5. 5. Backlink for your blog Get Ranking of your Blog Gain from your Blog Millions of Blog in your Hand Increase your Voice Technorati is an almost in real time search engine focused primarily on blogs, but really it picks up anything with an RSS feed that has been &quot;claimed&quot; in Technorati. Want to…
  6. 6. <ul><li>Technorati Launched in November 27, 2002 </li></ul><ul><li>Founded as the first Leading blog search engine </li></ul><ul><li> indexes millions of blog posts in real time and surfaces them in seconds. </li></ul><ul><li>The largest social media advertising network </li></ul><ul><li>The third largest blog media property* </li></ul><ul><li>The 6th largest social media property* </li></ul><ul><li>Online properties that introduce blog content to millions of consumers </li></ul>* comScore March 2009
  7. 7. Home Page
  8. 8. To Join… Join to Technorati
  9. 9. Claim
  10. 10. Verification code
  11. 11. Enter your Blog Url Enter your Blog URL
  12. 12. Claim with OpenID
  13. 13. Finished your Registration
  14. 14. Just Click here How to Claim your Blog ?
  15. 15. Enter your Blog URL and Click Begin Claim Button How to Claim your Blog ?
  16. 16. Here Totally Two Blog Claimed How to Claim your Blog ?
  17. 17. List of Blogs My Blogs
  18. 18. Blogs Directory
  19. 19. Photo Gallery Photo Collection from Blogs Photo collection with Blog Info
  20. 20. Video Gallery Related Video Tag
  21. 21. How to add Favorite Blogs ? Enter your favorite Blogs URL Enter your favorite Blogs Tags Short view Sadhas Blog Short view Flexdot Blog Posts from Favorites
  22. 22. How to Create WatchList ? Enter you Tags Result Page
  23. 23. How to Create WatchList ? Result Count Search Blogs
  24. 24. How to Ping your Blog’s Enter your Blog Url
  25. 25. Widgets
  26. 26. Charts <ul><li>Technorati charts allow you to visualize the impact an individual tag has on the Blogosphere by graphing the number of times the tag occurs in blog posts across the web. </li></ul><ul><li>You can build a chart to graph one tag or compare up to five tags at once. Once you are satisfied with a chart, add it as a widget on your own blog! </li></ul>
  27. 27. Charts Tags Chart Search tags within 30 days
  28. 28. Charts Comparison Nokia & Sony Ericsson To change charts time frame Nokia Sony Ericsson
  29. 29. State of the Blogosphere / 2008
  30. 30. <ul><li>Blogging is … </li></ul><ul><ul><li>A truly global phenomenon: </li></ul></ul><ul><ul><ul><li>81 languages in June 2008, </li></ul></ul></ul><ul><ul><ul><li>66 countries across six continents. </li></ul></ul></ul><ul><li>Blogs are Profitable </li></ul><ul><ul><li>The mean annual revenue is $6,000 with $75K+ in revenue for those with 100,000 </li></ul></ul>State of the Blogosphere / 2008
  31. 31. <ul><li>Global Snapshot of Bloggers </li></ul>State of the Blogosphere / 2008 Demographics Bloggers (N=550) European Bloggers (N=350) Asian Bloggers (N=173) Male 57% 73% 73% Age 18-34 years old 42% 48% 73% 35+ 58% 52% 27% Single 26% 31% 57% Employed full-time 56% 53% 45% Household income >$75,000 51% 34% 9% College graduate 74% 67% 69% Average blogging tenure (months) 35 33 30 Median Annual Investment $80 $15 $30 Median Annual Revenue $200 $200 $120 % Blogs with advertising 52% 50% 60% Average Monthly Unique Visitors 18,000 24,000 26,000
  32. 32. <ul><li>Segment Snapshot of Bloggers </li></ul>State of the Blogosphere / 2008 Demographics Personal (N=1015) Corporate (N=156) Professional (N=590) With Advertising (N=695) No Advertising (N=595) Male 64% 70% 72% 66% 66% Age 18-34 years old 52% 45% 48% 53% 45% 35+ 48% 55% 52% 47% 55% Single 36% 24% 31% 34% 34% Employed full-time 52% 51% 55% 49% 56% Household income>$75k 37% 49% 42% 40% 37% College graduate 70% 74% 74% 69% 72% Average blogging tenure (months) 35 35 38 35 33 Median Annual Investment $100 $200 $150 $100 0 Median Annual Revenue $120 $250 $300 $200 0 % Blogs with Advertising 53% 64% 59% 100% 0% Average Monthly Unique Visitors 12,000 39,000 44,000 46,000 4,000
  33. 33. <ul><li>Global Bloggers by Gender </li></ul>State of the Blogosphere / 2008 Demographics Female (N=438) Male (N=852) Personal Blog 83% 76% Professional Blog 38% 50% Age 18-24 years old 9% 15% 25+ 91% 85% Single 29% 36% Employed full-time 44% 56% Median Annual Investment $30 $60 Median Annual Revenue $100 $200 % Blogs with advertising 53% 54% Sell Through a Blog ad Network* 16% 7% Have Affiliate ads* 41% 32% Have Contextual ads* 61% 73%
  34. 34. <ul><li>We house about 10 TB of core data in MySQL over about 20 machines </li></ul><ul><li>With replication, we add 100TB and 200 machines more </li></ul><ul><li>We grow at about 1TB per day in total </li></ul><ul><li>We use a service oriented architecture to separate physical and logical access </li></ul><ul><li>We use commodity hardware and Open Source software </li></ul>Technorati Background
  35. 35. SCALING TECHNORATI TAGS Technorati Background <ul><li>Partition data by Entity (tags and posttags) </li></ul><ul><li>Blend of InnoDB and MyISAM based on use over time </li></ul><ul><li>Replicate to distribute query load and async calculations </li></ul>
  36. 36. MYISAM VS. INNODB Technorati Background <ul><li>Different storage engines serve very different purposes. </li></ul><ul><li>InnoDB is the right choice for Master-class DB’s where data integrity is key and write loads are high </li></ul><ul><li>MyISAM is the right choice for GROUP BY queries and for read-mostly applications </li></ul>
  37. 37. PARTITIONING Technorati Background <ul><li>Consider data access methods </li></ul><ul><li>Measure write and queries rates </li></ul><ul><li>Partition data by various dimensions </li></ul><ul><ul><ul><li>Time </li></ul></ul></ul><ul><ul><ul><li>Key </li></ul></ul></ul><ul><ul><ul><li>Entity </li></ul></ul></ul><ul><ul><ul><li>Random key </li></ul></ul></ul><ul><ul><ul><li>Fixed vs. Variable length columns </li></ul></ul></ul>
  38. 38. PARTITIONING Technorati Background <ul><li>At Technorati, we use all of these and some in combination </li></ul><ul><li>Cosmos DB for the entire Blogosphere </li></ul><ul><ul><li>ID based using mod to allocate to shard </li></ul></ul><ul><ul><li>Entity based to organize commonly queried lookup tables in one location </li></ul></ul><ul><ul><li>Entity based but ID range partitioned </li></ul></ul><ul><ul><li>Time based for reporting data (hourly or daily) </li></ul></ul>
  39. 39. PARTITIONING : EXAMPLES Technorati Background <ul><li>Main data set is sharded by Blog ID with a central sequence generation and map </li></ul><ul><ul><li>Collation is performed in the application tier </li></ul></ul><ul><li>Blog post data is split between fixed length and variable length columns </li></ul>
  40. 40. Technorati Background REPLICATION <ul><li>MySQL replication is an essential tool to distribute query load and provide for redundancy. </li></ul><ul><li>Master -> Master -> Slave can be used to distribute common lookup tables </li></ul><ul><li>mysqldump is also a good way to bootstrap a new slave </li></ul>
  41. 41. CONFIGURATION FOR RELIABILITY AND PERFORMANCE Technorati Background Master InnoDB Backup InnoDB Query Slave MyISAM Query Slave MyISAM Query Slave MyISAM
  42. 42. <ul><ul><li>Search Authority </li></ul></ul><ul><ul><li>Search Blogs, Photos, Video </li></ul></ul><ul><ul><li>Search Keyword </li></ul></ul><ul><ul><li>Search URL </li></ul></ul><ul><ul><li>Search Tags </li></ul></ul>Technorati Search
  43. 43. Search Engine Authority Search Authority List Authority Rank
  44. 44. Search Engine Blog Search
  45. 45. Search Engine Post Search Post in Wordpress Result in Technorati Search Post Title of Post Post List
  46. 46. Search Engine Result Page Keyword Search Enter your keyword Select Search category
  47. 47. Search Engine Result Page Enter your URL annauniv URL Search
  48. 48. Search Engine Result Page Enter your Tag Iraq Tag Info Iraq Tag Info Blog Tag Search
  49. 49. Search Engine Select Photos Search Enter Your Keyword Photos pick from Flickr Photo Search
  50. 50. Search Engine Select Video Search Enter Your Keyword Video pick from Youtube Video Search
  51. 51. <ul><ul><li>Blogs Basics </li></ul></ul><ul><ul><li>Top 100 Blogs </li></ul></ul><ul><ul><li>Technorati Blogs </li></ul></ul>Blog
  52. 52. <ul><li>What's a weblog? </li></ul><ul><ul><li>A weblog, or &quot;blog&quot;, is a personal journal on the Web </li></ul></ul><ul><ul><li>Weblog are highly influential and have enormous readership </li></ul></ul>Blogging Basics
  53. 53. <ul><li>Why are blogs important? </li></ul><ul><ul><li>It allow millions of people to easily publish their ideas, and more people to comment on them. </li></ul></ul><ul><ul><li>An increasing number of people reading, writing, and commenting on blogs. </li></ul></ul><ul><ul><li>Weblogs allow everyone to have a voice. </li></ul></ul>Blogging Basics (Contd…)
  54. 54. <ul><li>Who is a blogger ? </li></ul><ul><ul><li>A blogger is someone who writes a blog. </li></ul></ul><ul><li>What is the blogosphere? </li></ul><ul><ul><li>Blogosphere is a word used to describe the online community of bloggers and their writings. </li></ul></ul>Blogging Basics (Contd…)
  55. 55. <ul><li>What is RSS? </li></ul><ul><ul><li>RSS is a file format that allows anyone with a website from large media companies to individual commentators to easily &quot;syndicate&quot; their content . </li></ul></ul><ul><ul><li>The content that is syndicated is often not the full entry, but excerpts and links back to the originating website . </li></ul></ul>Blogging Basics (Contd…)
  56. 56. <ul><li>What is &quot;syndication&quot; ? </li></ul><ul><ul><li>making part of a website available for consumption in a specialized reader or for other sites to use and publish, often for free. </li></ul></ul><ul><ul><li>The part of a site made available for such syndication is most often a &quot;RSS newsfeed&quot; that lets other tools and sites display some or all of the site's content with proper attributions and links to the original source. </li></ul></ul>Blogging Basics (Contd…)
  57. 57. Blog Top 100 Blogs Sort blogs by Top Authority Sort blogs by Number of Fans
  58. 58. Blog Technorati News Blogs
  59. 59. <ul><ul><li>Microblogs (Twittorati) </li></ul></ul>Micro Blogs
  60. 60. Introduction of Twittorati <ul><li>Twittorati aggregates tweets from major blogs. </li></ul><ul><li>Users can filter tweets by topic, see most-tweeted blog posts and compare blogosphere and Twitter trends. </li></ul><ul><li>&quot;Writer pages&quot; also display each tweeter's blogs as well as Twitter data and Technorati Authority. </li></ul><ul><li>Twittorati currently only features tweets from Technorati's Top 100 Bloggers </li></ul><ul><li>Technorati is a blog search engine that uses various data points to determine the &quot;authority&quot; of a blog. </li></ul>
  61. 61. Top 100 Blogs on Twittorati Technorati Authority Top 100 Blogs list Technorati & Twitter Tags
  62. 62. <ul><ul><li>RSS Feed With Examples </li></ul></ul>Technorati RSS Feed
  63. 63. RSS Feed work in Technorati <ul><li>Technorati has integrated RSS feeds throughout the system. </li></ul><ul><li>Technorati has RSS feeds on Watchlist, Tags, Favorites, etc., </li></ul>Example: Favorites Step: 1 Click
  64. 64. RSS work in Technorati Step: 2 Added to Favorites
  65. 65. RSS work in Technorati Step: 3 Boing Boing Site displayed here through RSS Feed Search their Favorites
  66. 66. <ul><ul><li>Bookmark </li></ul></ul><ul><ul><li>Example </li></ul></ul>Technorati Bookmark
  67. 67. Bookmark <ul><li>Bookmarks are stored within a web browser on a computer and Favorites. </li></ul><ul><li>All of the bookmarks collected by all users can also be searched by tag, and the most popular links at a given time give a glimpse of the web in motion. </li></ul>
  68. 68. How to Bookmark Click Bookmark Click Bookmarked added Blog
  69. 69. <ul><ul><li>Technorati Tag Introduction </li></ul></ul><ul><ul><li>Example </li></ul></ul>Technorati Tags
  70. 70. Tags Search <ul><li>Tagging is a relatively new way to categorize relevant information on the web. </li></ul><ul><li>Technorati tracks 24 million sites. </li></ul><ul><li>Technorati is a real-time search engine that keeps track of what is going on in the blogosphere — the world of weblogs. </li></ul>
  71. 71. Popular Collections (Tags) This tags below are sized according to their popularity
  72. 72. Tags Search Result Page Result Count Filter Setting Result Info Blogcrtics Article
  73. 73. Tags Search Posted tags in my blogs Eg: Blurbs Example
  74. 74. Tags Search Tag Search in Technorati Search Result of my blogs Result in Technorati
  75. 75. <ul><li>Reff: </li></ul><ul><li>http:// / </li></ul><ul><li>http:// </li></ul><ul><li> </li></ul><ul><li>MySQL user Conference </li></ul>
  76. 76. Thank you…. ? E-Mail: [email_address] , [email_address]