Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
  Role of Text Mining in Search Engines IST 345 Term Project Team 3 Fall 2008 Role of Text Mining in Search Engine
Agenda Role of Text Mining in Search Engine Text Mining in Search Engine Case Study 1 Introduction 2 Current Trends 3 4 Fu...
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Role of Text Mining in Search Engine
Really RESULTS How do Search Engine Work? Role of Text Mining in Search Engine
1. New Website is posted, Linked to, or has its content altered  Role of Text Mining in Search Engine
2. Search Engine’s Spider Crawl the page Role of Text Mining in Search Engine Goglebot: Google Slurp: Yahoo MSNbot: MSN
Skims text, image descriptions, meta data, page titles and URL Role of Text Mining in Search Engine
Follow links, count links In and Out Role of Text Mining in Search Engine
Search Wiki Engine SEO SEM Web Role of Text Mining in Search Engine Index key terms, count word frequency
Why Mining in Search Engine? <ul><li>Overwhelming information in typical user query results </li></ul><ul><li>Results are ...
<ul><li>Additional techniques are needed to help the users analyze the search results efficiently and drill down to the in...
Text Mining <ul><li>Text mining applications today draw on a wide range of techniques and serve many purposes in informati...
Use of Text Mining in Search Engine <ul><li>Text categorization (faceted search systems) </li></ul><ul><ul><li>Using multi...
Role of Text Mining in Search Engine <ul><li>Contextualized clustering </li></ul><ul><ul><li>Group the search results by t...
Clustering Engines <ul><li>Scatter/Gather  </li></ul><ul><li>Grouper </li></ul><ul><li>The Lingo system  </li></ul><ul><li...
Clusty / Vivisimo Engine Role of Text Mining in Search Engine
Role of Text Mining in Search Engine Future Trends <ul><li>Anticipated to expand 1000 times </li></ul><ul><li>With the int...
Future Trend <ul><li>Introduction   of full-text search engines such as AltaVista,   Excite, HotBot,   Infoseek, Lycos,   ...
Role of Text Mining in Search Engine Case Study: Data Crow
Role of Text Mining in Search Engine Case Study: Data Crow
Role of Text Mining in Search Engine Customized Search <ul><li>Music </li></ul><ul><li>Data Crow contains two separate mod...
Role of Text Mining in Search Engine Conclusion <ul><li>Learnt the evolution of Search Engine </li></ul><ul><li>Efficiency...
Role of Text Mining in Search Engine <ul><li>Which of the following is not a search engine? </li></ul><ul><ul><li>Google <...
Role of Text Mining in Search Engine <ul><li>What search engine has the largest index of listings on the web? </li></ul><u...
Role of Text Mining in Search Engine <ul><li>Search Engines and directory are both the same thing because: </li></ul><ul><...
Role of Text Mining in Search Engine <ul><li>What was the first search engine ever created? </li></ul><ul><ul><li>  WWW Wa...
<ul><li>Q: Google is limited to how many search terms in one query: </li></ul><ul><ul><li>  16 </li></ul></ul><ul><ul><li>...
<ul><li>Q: How do search engines find out about sites on the Web? </li></ul><ul><ul><li>  Osmosis </li></ul></ul><ul><ul><...
Role of Text Mining in Search Engine
Upcoming SlideShare
Loading in …5
×

Role of Text Mining in Search Engine

32,777 views

Published on

Please leave me a mail at jaimodi891@yahoo.com if you like the content of document.

Published in: Technology, Design
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yxufevpm } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yxufevpm } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yxufevpm } ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/yxufevpm } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/yxufevpm } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/yxufevpm } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Role of Text Mining in Search Engine

  1. 1. Role of Text Mining in Search Engines IST 345 Term Project Team 3 Fall 2008 Role of Text Mining in Search Engine
  2. 2. Agenda Role of Text Mining in Search Engine Text Mining in Search Engine Case Study 1 Introduction 2 Current Trends 3 4 Future Trend 5 6 Conclusions
  3. 3. Role of Text Mining in Search Engine
  4. 4. Role of Text Mining in Search Engine
  5. 5. Role of Text Mining in Search Engine
  6. 6. Role of Text Mining in Search Engine
  7. 7. Role of Text Mining in Search Engine
  8. 8. Role of Text Mining in Search Engine
  9. 9. Role of Text Mining in Search Engine
  10. 10. Role of Text Mining in Search Engine
  11. 11. Really RESULTS How do Search Engine Work? Role of Text Mining in Search Engine
  12. 12. 1. New Website is posted, Linked to, or has its content altered Role of Text Mining in Search Engine
  13. 13. 2. Search Engine’s Spider Crawl the page Role of Text Mining in Search Engine Goglebot: Google Slurp: Yahoo MSNbot: MSN
  14. 14. Skims text, image descriptions, meta data, page titles and URL Role of Text Mining in Search Engine
  15. 15. Follow links, count links In and Out Role of Text Mining in Search Engine
  16. 16. Search Wiki Engine SEO SEM Web Role of Text Mining in Search Engine Index key terms, count word frequency
  17. 17. Why Mining in Search Engine? <ul><li>Overwhelming information in typical user query results </li></ul><ul><li>Results are only partly related to each other </li></ul><ul><li>Many users investigate only the two or three top ranked documents </li></ul><ul><li>Traditional lists of ranked documents do not seem to be sufficient for the exploratory search tasks </li></ul>Role of Text Mining in Search Engine
  18. 18. <ul><li>Additional techniques are needed to help the users analyze the search results efficiently and drill down to the information they are looking for. </li></ul><ul><li>Users need to explore the information </li></ul><ul><ul><li>Discovering new patterns, </li></ul></ul><ul><ul><li>New entities, and </li></ul></ul><ul><ul><li>Knowledge they do not even realize they needed </li></ul></ul>Role of Text Mining in Search Engine Why Mining in Search Engine?
  19. 19. Text Mining <ul><li>Text mining applications today draw on a wide range of techniques and serve many purposes in information management and business intelligence. </li></ul><ul><li>TM techniques can be organized into four categories: </li></ul><ul><ul><li>Classification techniques </li></ul></ul><ul><ul><li>Association analysis </li></ul></ul><ul><ul><li>Information extraction techniques </li></ul></ul><ul><ul><li>Clustering techniques </li></ul></ul>Role of Text Mining in Search Engine
  20. 20. Use of Text Mining in Search Engine <ul><li>Text categorization (faceted search systems) </li></ul><ul><ul><li>Using multi-dimensional categories to describe (groups of) documents </li></ul></ul><ul><ul><li>Richer descriptions </li></ul></ul><ul><ul><li>Expensive to develop the categories </li></ul></ul><ul><li>Semantic Web Search </li></ul><ul><ul><li>Linguistic analysis of text </li></ul></ul><ul><ul><li>Addition to purely statistical techniques </li></ul></ul>Role of Text Mining in Search Engine
  21. 21. Role of Text Mining in Search Engine <ul><li>Contextualized clustering </li></ul><ul><ul><li>Group the search results by topic </li></ul></ul><ul><ul><li>Clustering of documents according to terms found in the documents </li></ul></ul>Use of Text Mining in Search Engine
  22. 22. Clustering Engines <ul><li>Scatter/Gather </li></ul><ul><li>Grouper </li></ul><ul><li>The Lingo system </li></ul><ul><li>The Clusty/Vivisimo engine (www.clusty.com and www.vivisimo.com) </li></ul><ul><li>SnakeT </li></ul><ul><li>HOBSearch </li></ul>Role of Text Mining in Search Engine
  23. 23. Clusty / Vivisimo Engine Role of Text Mining in Search Engine
  24. 24. Role of Text Mining in Search Engine Future Trends <ul><li>Anticipated to expand 1000 times </li></ul><ul><li>With the introduction of full-text search engines such as AltaVista, Excite, HotBot, Infoseek, Lycos, and Northern Light, the Web can be viewed as a searchable 15-billion-word encyclopedia. </li></ul><ul><li>Nutch engine is the future search engine </li></ul><ul><li>Fetch several billion pages per month </li></ul><ul><li>Maintain an index of these pages </li></ul><ul><li>Search the index up to 1000 times per second </li></ul><ul><li>Provide very high quality search results </li></ul><ul><li>Operate at minimal cost </li></ul>
  25. 25. Future Trend <ul><li>Introduction   of full-text search engines such as AltaVista,   Excite, HotBot,   Infoseek, Lycos,   and Northern Light </li></ul><ul><li>Summarization of online documents </li></ul><ul><li>More efficient Categorization/Clustering for the search results </li></ul><ul><li>Entity Extraction by using linguistics and pattern detection </li></ul><ul><li>Answering intelligent questions </li></ul>Role of Text Mining in Search Engine
  26. 26. Role of Text Mining in Search Engine Case Study: Data Crow
  27. 27. Role of Text Mining in Search Engine Case Study: Data Crow
  28. 28. Role of Text Mining in Search Engine Customized Search <ul><li>Music </li></ul><ul><li>Data Crow contains two separate modules </li></ul><ul><ul><li>The Music Album and </li></ul></ul><ul><ul><li>Audio CD module </li></ul></ul><ul><li>Use one of the online services (MusicBrainz, Amazon, Discogs and others) to find information on your CD and or music files </li></ul><ul><li>Parse information from your mp3, flac, ape and or ogg file and fill missing information using an online service </li></ul>
  29. 29. Role of Text Mining in Search Engine Conclusion <ul><li>Learnt the evolution of Search Engine </li></ul><ul><li>Efficiency of Search Engine can be increased by using mining techniques </li></ul><ul><li>Increased demand from customized search </li></ul>
  30. 30. Role of Text Mining in Search Engine <ul><li>Which of the following is not a search engine? </li></ul><ul><ul><li>Google </li></ul></ul><ul><ul><li>Open Directory </li></ul></ul><ul><ul><li>Yahoo search </li></ul></ul><ul><ul><li>Lycos </li></ul></ul><ul><li>Open Directory </li></ul>
  31. 31. Role of Text Mining in Search Engine <ul><li>What search engine has the largest index of listings on the web? </li></ul><ul><ul><li>Yahoo </li></ul></ul><ul><ul><li>Google </li></ul></ul><ul><ul><li>MSN </li></ul></ul><ul><ul><li>Microsoft </li></ul></ul><ul><li>Google </li></ul>
  32. 32. Role of Text Mining in Search Engine <ul><li>Search Engines and directory are both the same thing because: </li></ul><ul><ul><li>They both index information </li></ul></ul><ul><ul><li>They’re both on the internet </li></ul></ul><ul><ul><li>They’re not the same thing </li></ul></ul><ul><ul><li>They both search for information </li></ul></ul><ul><li>They’re not the same thing </li></ul>
  33. 33. Role of Text Mining in Search Engine <ul><li>What was the first search engine ever created? </li></ul><ul><ul><li>  WWW Wanderer </li></ul></ul><ul><ul><li>  Google; created by Larry and Sergey in 1995 </li></ul></ul><ul><ul><li>Yahoo; created in 1994 </li></ul></ul><ul><ul><li>MSN Search; created in 1982 </li></ul></ul><ul><li>WWW Wanderer: technically not really a search engine, but a pioneer of the crawling process </li></ul>
  34. 34. <ul><li>Q: Google is limited to how many search terms in one query: </li></ul><ul><ul><li>  16 </li></ul></ul><ul><ul><li>18 </li></ul></ul><ul><ul><li>13 </li></ul></ul><ul><ul><li>15 </li></ul></ul><ul><li>15 </li></ul>Role of Text Mining in Search Engine
  35. 35. <ul><li>Q: How do search engines find out about sites on the Web? </li></ul><ul><ul><li>  Osmosis </li></ul></ul><ul><ul><li>Search engines automatically know everything on the Web. </li></ul></ul><ul><ul><li>Two different ways: search engine spiders index the information, or site owners submit it manually </li></ul></ul><ul><ul><li>Search engines have special features that enable them to know when your site is uploaded. It's called &quot;crystal ball technology.&quot; </li></ul></ul><ul><li>Two different ways: search engine spiders index the information, or site owners submit it manually. </li></ul>Role of Text Mining in Search Engine
  36. 36. Role of Text Mining in Search Engine

×