SlideShare a Scribd company logo
Michelle Post, Ph.D.
 What is it?
 Visible vs. Invisible

 How does it work?

 How big is it?

 Where is it going?

 Invisible Web Search Engines

 Invisible Web Databases

 Video Training

 Resources

 References




                                 © Michelle Post, Ph.D.   2
   “Searching on the Internet today can be compared to
    dragging a net across the surface of the ocean. While
    a great deal may be caught in the net, there is still a
    wealth of information that is deep, and therefore,
    missed. The reason is simple: Most of the Web's
    information is buried far down on dynamically
    generated sites, and standard search engines never
    find it” (Bergman, 2001, para. 2).
   “The "visible web" is what you can find using general
    web search engines. It's also what you see in almost
    all subject directories. The "invisible web" is what you
    cannot find using these types of tools” (UC Berkeley
    Library, n.d., para. 1).


                                    © Michelle Post, Ph.D.     3
   “The deep Web contains 99% of the
    information content of the Web; however,
    most of this information is contained in
    databases and is not indexed by search
    engines” (Gruchawaka, 2010, para. 1).
   “If the most coveted commodity of the
    Information Age is indeed information, then
    the value of deep Web content is
    immeasurable” (Bergman, 2001, para. 5).



                              Michelle Post, Ph.D.   4
Surface Web              Deep Web
Millions of web pages    Over 200,000 databases
1 billion documents      550 billion documents
19 terabytes             7,750 terabytes
Broad shallow coverage   Deep vertical coverage
Results contain ads      Results contain no ads
Content unevaluated      Content evaluated by experts
(Bergman, 2001)




                             © Michelle Post, Ph.D.     5
   “The deep Web is qualitatively different from
    the surface Web. Deep Web sources store
    their content in searchable databases that
    only produce results dynamically in response
    to a direct request” (Bergman, 2001, para. 4).




                              © Michelle Post, Ph.D.   6
   Public information on the Deep Web is currently 400 to
    550 times larger than the commonly defined World Wide
    Web.
   The Deep Web contains 7,500 terabytes of information,
    compared to 19 terabytes of information in the surface
    Web.
    The Deep Web contains nearly 550 billion individual
    documents compared to the 1 billion of the surface Web.
   More than an estimated 200,000 Deep Web sites presently
    exist.
   Sixty of the largest Deep Web sites collectively contain
    about 750 terabytes of information – sufficient by
    themselves to exceed the size of the surface Web by 40
    times. (CompletePlanet, n.d., para. 6)




                                     Michelle Post, Ph.D.      7
   “The deep Web is the fastest growing sector
    of the Web and it appears to be the „paradigm
    for the next generation Internet‟”
    (BrightPlanet, 2005, para. 35).




                             © Michelle Post, Ph.D.   8
   ResourceShelf -
    http://www.resourceshelf.com/
   Direct Search -
    http://www.freepint.com/gary/direct.htm
   Complete Planet -
    http://www.completeplanet.com/




                             Michelle Post, Ph.D.   9
   Listing of Largest Deep Web Sites -
    http://aip.completeplanet.com/aip-
    engines/help/largest_engines.jsp
   Directory of Open Access Journals -
    http://www.doaj.org/
   Educator's Reference Desk - http://www.eduref.org/
   Find Articles - http://www.findarticles.com/
   On-Line Encyclopedia of Integer Sequences -
    http://www.research.att.com/~njas/sequences/
   PubMed -
    http://www.ncbi.nlm.nih.gov/entrez/query.fcgi
   Super Searchers Web Page -
    http://www.infotoday.com/supersearchers/

                                  Michelle Post, Ph.D.   10
   The Virtual Private Library and Deep Web -
    http://www.dailymotion.com/video/x9udyo_t
    he-virtual-private-library-and-dee_news




                            Michelle Post, Ph.D.   11
100 Time-Saving Search Engines for Serious Scholars -
  http://www.onlineuniversities.com/blog/2010/03/100-
  time-saving-search-engines-for-serious-scholars/
Deep Web FAQ - http://aip.completeplanet.com/aip-
  engines/help/help_deepwebfaqs.jsp
The Invisible Web Databases -
  http://www.noodletools.com/debbie/literacies/informatio
  n/5locate/advicedepth.html
Those Dark Hiding Places: The Invisible Web Revealed -
  http://library.rider.edu/scholarly/rlackie/Invisible/Inv_We
  b.html
White Paper: The Deep Web: Surfacing Hidden Value -
  http://quod.lib.umich.edu/cgi/t/text/text-
  idx?c=jep;view=text;rgn=main;idno=3336451.0007.104




                                     Michelle Post, Ph.D.       12
Bergman, M. (2001, August). White Paper: The deep web: Surfacing
  hidden value. The Journal of Electronic Publishing, 7(1), doi:
  10.3998/3336451.0007.104. Retrieved from
  http://quod.lib.umich.edu/cgi/t/text/text-
  idx?c=jep;view=text;rgn=main;idno=3336451.0007.104
BrightPlanet. (2005). Deep webfaq. Retrieved from
  http://www.brightplanet.com/
CompletePlanet. (n.d.). How large is the deep web. Retrieved from
  http://aip.completeplanet.com/aip-
  engines/help/help_deepwebfaqs.jsp
Gruchawka, S. (2010). Using the deep web. Retrieved from
  http://techdeepweb.com/
UC Berkeley. (n.d.). Invisible or deep web: What it is, how to find it,
  and Its inherent ambiguity. Retrieved from
  http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/Invisi
  bleWeb.html




                                         © Michelle Post, Ph.D.           13

More Related Content

What's hot

Better Management Through Web 2.0 6 Nov 2008
Better Management Through Web 2.0 6 Nov 2008Better Management Through Web 2.0 6 Nov 2008
Better Management Through Web 2.0 6 Nov 2008Frank Rees
 
Great Database Debate
Great Database DebateGreat Database Debate
Great Database DebateFloyd Pentlin
 
Combining Storytelling and Web Archives
Combining Storytelling and Web ArchivesCombining Storytelling and Web Archives
Combining Storytelling and Web ArchivesMichael Nelson
 
Gone today, here tomorrow: the future of government information and the digit...
Gone today, here tomorrow: the future of government information and the digit...Gone today, here tomorrow: the future of government information and the digit...
Gone today, here tomorrow: the future of government information and the digit...James Jacobs
 
Digital FDLP Louisiana GODORT 2012 slides+notes
Digital FDLP Louisiana GODORT 2012 slides+notesDigital FDLP Louisiana GODORT 2012 slides+notes
Digital FDLP Louisiana GODORT 2012 slides+notesJames Jacobs
 
Digital Visitors and Residents: Project Feedback
Digital Visitors and Residents: Project FeedbackDigital Visitors and Residents: Project Feedback
Digital Visitors and Residents: Project Feedbackjisc-elearning
 
We Need Multiple, Independent Web Archives
We Need Multiple, Independent Web ArchivesWe Need Multiple, Independent Web Archives
We Need Multiple, Independent Web ArchivesMichael Nelson
 
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...What is #LODLAM?! Understanding linked open data in libraries, archives [and ...
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...Alison Hitchens
 
Linked Open Data for Archives
Linked Open Data for ArchivesLinked Open Data for Archives
Linked Open Data for ArchivesCliff Landis
 
Impact of HTTP Cookie Violations in Web Archives
Impact of HTTP Cookie Violations in Web ArchivesImpact of HTTP Cookie Violations in Web Archives
Impact of HTTP Cookie Violations in Web ArchivesSawood Alam
 
An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)Cliff Landis
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesYasmin AlNoamany, PhD
 
Interoperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync OverviewInteroperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync OverviewPeter Murray
 
Translating mediav1
Translating mediav1Translating mediav1
Translating mediav1Amy Fong
 
[[edit]] this GLAM
[[edit]] this GLAM[[edit]] this GLAM
[[edit]] this GLAMwittylama
 
Connect With Your Users: Communicate Using Social Software Tools
Connect With Your Users: Communicate Using Social Software ToolsConnect With Your Users: Communicate Using Social Software Tools
Connect With Your Users: Communicate Using Social Software ToolsRobFav
 
Impact of URI Canonicalization on Memento Count
Impact of URI Canonicalization on Memento Count Impact of URI Canonicalization on Memento Count
Impact of URI Canonicalization on Memento Count Mat Kelly
 

What's hot (20)

Blogs
BlogsBlogs
Blogs
 
Web2
Web2Web2
Web2
 
Better Management Through Web 2.0 6 Nov 2008
Better Management Through Web 2.0 6 Nov 2008Better Management Through Web 2.0 6 Nov 2008
Better Management Through Web 2.0 6 Nov 2008
 
Great Database Debate
Great Database DebateGreat Database Debate
Great Database Debate
 
Combining Storytelling and Web Archives
Combining Storytelling and Web ArchivesCombining Storytelling and Web Archives
Combining Storytelling and Web Archives
 
Gone today, here tomorrow: the future of government information and the digit...
Gone today, here tomorrow: the future of government information and the digit...Gone today, here tomorrow: the future of government information and the digit...
Gone today, here tomorrow: the future of government information and the digit...
 
Digital FDLP Louisiana GODORT 2012 slides+notes
Digital FDLP Louisiana GODORT 2012 slides+notesDigital FDLP Louisiana GODORT 2012 slides+notes
Digital FDLP Louisiana GODORT 2012 slides+notes
 
Digital Visitors and Residents: Project Feedback
Digital Visitors and Residents: Project FeedbackDigital Visitors and Residents: Project Feedback
Digital Visitors and Residents: Project Feedback
 
We Need Multiple, Independent Web Archives
We Need Multiple, Independent Web ArchivesWe Need Multiple, Independent Web Archives
We Need Multiple, Independent Web Archives
 
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...What is #LODLAM?! Understanding linked open data in libraries, archives [and ...
What is #LODLAM?! Understanding linked open data in libraries, archives [and ...
 
Linked Open Data for Archives
Linked Open Data for ArchivesLinked Open Data for Archives
Linked Open Data for Archives
 
Impact of HTTP Cookie Violations in Web Archives
Impact of HTTP Cookie Violations in Web ArchivesImpact of HTTP Cookie Violations in Web Archives
Impact of HTTP Cookie Violations in Web Archives
 
Making a Transformation
Making a TransformationMaking a Transformation
Making a Transformation
 
An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web Archives
 
Interoperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync OverviewInteroperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync Overview
 
Translating mediav1
Translating mediav1Translating mediav1
Translating mediav1
 
[[edit]] this GLAM
[[edit]] this GLAM[[edit]] this GLAM
[[edit]] this GLAM
 
Connect With Your Users: Communicate Using Social Software Tools
Connect With Your Users: Communicate Using Social Software ToolsConnect With Your Users: Communicate Using Social Software Tools
Connect With Your Users: Communicate Using Social Software Tools
 
Impact of URI Canonicalization on Memento Count
Impact of URI Canonicalization on Memento Count Impact of URI Canonicalization on Memento Count
Impact of URI Canonicalization on Memento Count
 

Viewers also liked

M.Phil Computer Science Cloud Computing Projects
M.Phil Computer Science Cloud Computing ProjectsM.Phil Computer Science Cloud Computing Projects
M.Phil Computer Science Cloud Computing ProjectsVijay Karan
 
WSI World - Content Marketing
 WSI World - Content Marketing WSI World - Content Marketing
WSI World - Content MarketingWSI WORLD CANADA
 
Семантическая обработка медицинских данных в задачах диагностики и управления...
Семантическая обработка медицинских данных в задачах диагностики и управления...Семантическая обработка медицинских данных в задачах диагностики и управления...
Семантическая обработка медицинских данных в задачах диагностики и управления...Alexandre Prozoroff
 
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналов
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналовНоябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналов
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналовAlexandre Prozoroff
 
Dasar Fotografi : Komposisi
Dasar Fotografi : KomposisiDasar Fotografi : Komposisi
Dasar Fotografi : KomposisiSeggaf Almudhary
 
ق.كرم لمعي -عمانوئيل الله معنا - منبر الكنيسه الانجيليه بالابراهيميه ا ش1...
  ق.كرم لمعي -عمانوئيل  الله معنا - منبر الكنيسه الانجيليه بالابراهيميه  ا ش1...  ق.كرم لمعي -عمانوئيل  الله معنا - منبر الكنيسه الانجيليه بالابراهيميه  ا ش1...
ق.كرم لمعي -عمانوئيل الله معنا - منبر الكنيسه الانجيليه بالابراهيميه ا ش1...Ibrahimia Church Ftriends
 
026 30 03-2014 am الكلمة الخامسة - أنا عطشان
026  30  03-2014 am            الكلمة الخامسة  - أنا عطشان026  30  03-2014 am            الكلمة الخامسة  - أنا عطشان
026 30 03-2014 am الكلمة الخامسة - أنا عطشانIbrahimia Church Ftriends
 
Cory mosley what matters most
Cory mosley what matters most Cory mosley what matters most
Cory mosley what matters most Sean Bradley
 
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯ
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯ
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯKhemjira_P
 
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...IoMT - Technological Environment of Personalized Medicine and New Era of Heal...
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...Alexandre Prozoroff
 
EGI ENGAGE Fishery & Marine Legal Interoperability
EGI ENGAGE Fishery & Marine Legal InteroperabilityEGI ENGAGE Fishery & Marine Legal Interoperability
EGI ENGAGE Fishery & Marine Legal Interoperabilitycthanopoulos
 
IEEE 2014 C# Projects
IEEE 2014 C# ProjectsIEEE 2014 C# Projects
IEEE 2014 C# ProjectsVijay Karan
 
LLCprocessimprovement
LLCprocessimprovementLLCprocessimprovement
LLCprocessimprovementslidewayne
 
Holy orders & Anointing of the sick
Holy orders  &  Anointing of the sickHoly orders  &  Anointing of the sick
Holy orders & Anointing of the sickDolores Vasquez
 
عشر دقائق للقس لبيب مشرقى
عشر دقائق  للقس لبيب مشرقىعشر دقائق  للقس لبيب مشرقى
عشر دقائق للقس لبيب مشرقىIbrahimia Church Ftriends
 

Viewers also liked (20)

M.Phil Computer Science Cloud Computing Projects
M.Phil Computer Science Cloud Computing ProjectsM.Phil Computer Science Cloud Computing Projects
M.Phil Computer Science Cloud Computing Projects
 
WSI World - Content Marketing
 WSI World - Content Marketing WSI World - Content Marketing
WSI World - Content Marketing
 
Семантическая обработка медицинских данных в задачах диагностики и управления...
Семантическая обработка медицинских данных в задачах диагностики и управления...Семантическая обработка медицинских данных в задачах диагностики и управления...
Семантическая обработка медицинских данных в задачах диагностики и управления...
 
Final electrochemistry
Final electrochemistryFinal electrochemistry
Final electrochemistry
 
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналов
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналовНоябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналов
Ноябрь 2014. Обзор бытовых браслетов для непрерывного снятия биосигналов
 
Dasar Fotografi : Komposisi
Dasar Fotografi : KomposisiDasar Fotografi : Komposisi
Dasar Fotografi : Komposisi
 
ق.كرم لمعي -عمانوئيل الله معنا - منبر الكنيسه الانجيليه بالابراهيميه ا ش1...
  ق.كرم لمعي -عمانوئيل  الله معنا - منبر الكنيسه الانجيليه بالابراهيميه  ا ش1...  ق.كرم لمعي -عمانوئيل  الله معنا - منبر الكنيسه الانجيليه بالابراهيميه  ا ش1...
ق.كرم لمعي -عمانوئيل الله معنا - منبر الكنيسه الانجيليه بالابراهيميه ا ش1...
 
Anointing of the sick
Anointing of  the sickAnointing of  the sick
Anointing of the sick
 
026 30 03-2014 am الكلمة الخامسة - أنا عطشان
026  30  03-2014 am            الكلمة الخامسة  - أنا عطشان026  30  03-2014 am            الكلمة الخامسة  - أنا عطشان
026 30 03-2014 am الكلمة الخامسة - أنا عطشان
 
Top 3 tips for google+
Top 3 tips for google+Top 3 tips for google+
Top 3 tips for google+
 
Cory mosley what matters most
Cory mosley what matters most Cory mosley what matters most
Cory mosley what matters most
 
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯ
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯ
ความรู้เบื้องต้นเกี่ยวกับระบบสารสนเทศฯ
 
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...IoMT - Technological Environment of Personalized Medicine and New Era of Heal...
IoMT - Technological Environment of Personalized Medicine and New Era of Heal...
 
EGI ENGAGE Fishery & Marine Legal Interoperability
EGI ENGAGE Fishery & Marine Legal InteroperabilityEGI ENGAGE Fishery & Marine Legal Interoperability
EGI ENGAGE Fishery & Marine Legal Interoperability
 
IEEE 2014 C# Projects
IEEE 2014 C# ProjectsIEEE 2014 C# Projects
IEEE 2014 C# Projects
 
LLCprocessimprovement
LLCprocessimprovementLLCprocessimprovement
LLCprocessimprovement
 
Holy orders & Anointing of the sick
Holy orders  &  Anointing of the sickHoly orders  &  Anointing of the sick
Holy orders & Anointing of the sick
 
Alexander the Great
Alexander the GreatAlexander the Great
Alexander the Great
 
Lego Serious Play - URL - a11ymtl-2014
Lego Serious Play - URL - a11ymtl-2014Lego Serious Play - URL - a11ymtl-2014
Lego Serious Play - URL - a11ymtl-2014
 
عشر دقائق للقس لبيب مشرقى
عشر دقائق  للقس لبيب مشرقىعشر دقائق  للقس لبيب مشرقى
عشر دقائق للقس لبيب مشرقى
 

Similar to InvisibleWeb-DeeperWeb

Google & garbage lsta 2012
Google & garbage lsta 2012Google & garbage lsta 2012
Google & garbage lsta 2012Paige Jaeger
 
Enhancing the Web Experience
Enhancing the Web ExperienceEnhancing the Web Experience
Enhancing the Web ExperienceJohn Breslin
 
The Semantic Web Exists. What Next?
The Semantic Web Exists. What Next?The Semantic Web Exists. What Next?
The Semantic Web Exists. What Next?Anna Fensel
 
HMID6303 Assignment 1 - Yeap
HMID6303 Assignment 1 - YeapHMID6303 Assignment 1 - Yeap
HMID6303 Assignment 1 - YeapYeap Aun
 
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...Emily Nimsakont
 
Scholarship in a connected world: New ways to know, new ways to show
Scholarship in a connected world: New ways to know, new ways to showScholarship in a connected world: New ways to know, new ways to show
Scholarship in a connected world: New ways to know, new ways to showDerek Keats
 
Mashing up the web” - combining, fusing, creating ideas in linking web 2.0 t...
Mashing up the web”  - combining, fusing, creating ideas in linking web 2.0 t...Mashing up the web”  - combining, fusing, creating ideas in linking web 2.0 t...
Mashing up the web” - combining, fusing, creating ideas in linking web 2.0 t...Allan Cho
 
BIZ 2401 and the Library
BIZ 2401 and the LibraryBIZ 2401 and the Library
BIZ 2401 and the LibraryTraciwm
 
Deep Web
Deep WebDeep Web
Deep WebSt John
 
Launching Library 2.0
Launching Library 2.0Launching Library 2.0
Launching Library 2.0pddsnn
 
Promises and Pitfalls: Linked Data, Privacy, and Library Catalogs
Promises and Pitfalls: Linked Data, Privacy, and Library CatalogsPromises and Pitfalls: Linked Data, Privacy, and Library Catalogs
Promises and Pitfalls: Linked Data, Privacy, and Library CatalogsEmily Nimsakont
 
Strategic scenarios in digital content and digital business
Strategic scenarios in digital content and digital businessStrategic scenarios in digital content and digital business
Strategic scenarios in digital content and digital businessMarco Brambilla
 
Let the trumpet sound 2003 version
Let the trumpet sound 2003 versionLet the trumpet sound 2003 version
Let the trumpet sound 2003 versionJohan Koren
 
The Information Revolution
The Information RevolutionThe Information Revolution
The Information Revolutionrpop1012
 

Similar to InvisibleWeb-DeeperWeb (20)

Deep web
Deep webDeep web
Deep web
 
Towards Knowledge-Enabled Society
Towards Knowledge-Enabled SocietyTowards Knowledge-Enabled Society
Towards Knowledge-Enabled Society
 
Deep Web
Deep WebDeep Web
Deep Web
 
Google & garbage lsta 2012
Google & garbage lsta 2012Google & garbage lsta 2012
Google & garbage lsta 2012
 
Julie Clegg
Julie CleggJulie Clegg
Julie Clegg
 
Enhancing the Web Experience
Enhancing the Web ExperienceEnhancing the Web Experience
Enhancing the Web Experience
 
PRSENTATIION ON INTERNET
PRSENTATIION ON INTERNETPRSENTATIION ON INTERNET
PRSENTATIION ON INTERNET
 
Prof. John Domingue
Prof. John DomingueProf. John Domingue
Prof. John Domingue
 
The Semantic Web Exists. What Next?
The Semantic Web Exists. What Next?The Semantic Web Exists. What Next?
The Semantic Web Exists. What Next?
 
HMID6303 Assignment 1 - Yeap
HMID6303 Assignment 1 - YeapHMID6303 Assignment 1 - Yeap
HMID6303 Assignment 1 - Yeap
 
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...
What Is Linked Data, and What Does it Mean for Libraries? ALAO TEDSIG Spring ...
 
Scholarship in a connected world: New ways to know, new ways to show
Scholarship in a connected world: New ways to know, new ways to showScholarship in a connected world: New ways to know, new ways to show
Scholarship in a connected world: New ways to know, new ways to show
 
Mashing up the web” - combining, fusing, creating ideas in linking web 2.0 t...
Mashing up the web”  - combining, fusing, creating ideas in linking web 2.0 t...Mashing up the web”  - combining, fusing, creating ideas in linking web 2.0 t...
Mashing up the web” - combining, fusing, creating ideas in linking web 2.0 t...
 
BIZ 2401 and the Library
BIZ 2401 and the LibraryBIZ 2401 and the Library
BIZ 2401 and the Library
 
Deep Web
Deep WebDeep Web
Deep Web
 
Launching Library 2.0
Launching Library 2.0Launching Library 2.0
Launching Library 2.0
 
Promises and Pitfalls: Linked Data, Privacy, and Library Catalogs
Promises and Pitfalls: Linked Data, Privacy, and Library CatalogsPromises and Pitfalls: Linked Data, Privacy, and Library Catalogs
Promises and Pitfalls: Linked Data, Privacy, and Library Catalogs
 
Strategic scenarios in digital content and digital business
Strategic scenarios in digital content and digital businessStrategic scenarios in digital content and digital business
Strategic scenarios in digital content and digital business
 
Let the trumpet sound 2003 version
Let the trumpet sound 2003 versionLet the trumpet sound 2003 version
Let the trumpet sound 2003 version
 
The Information Revolution
The Information RevolutionThe Information Revolution
The Information Revolution
 

More from The Post Institute: Center for Life-Long Learning

More from The Post Institute: Center for Life-Long Learning (20)

MPost Helps Page
MPost Helps PageMPost Helps Page
MPost Helps Page
 
Instagram for business
Instagram for businessInstagram for business
Instagram for business
 
Performing a social media audit
Performing a social media auditPerforming a social media audit
Performing a social media audit
 
Keywords are key
Keywords are keyKeywords are key
Keywords are key
 
Apa 6th Headers
Apa 6th HeadersApa 6th Headers
Apa 6th Headers
 
Content Curation Tools Are Cool
Content Curation Tools Are CoolContent Curation Tools Are Cool
Content Curation Tools Are Cool
 
Social media in 7 questions
Social media in 7 questionsSocial media in 7 questions
Social media in 7 questions
 
Its my favorite-vol2
Its my favorite-vol2Its my favorite-vol2
Its my favorite-vol2
 
Its My Favorite - Vol1
Its My Favorite - Vol1Its My Favorite - Vol1
Its My Favorite - Vol1
 
Social media what why where
Social media what why whereSocial media what why where
Social media what why where
 
Where to begin with social media map
Where to begin with social media mapWhere to begin with social media map
Where to begin with social media map
 
Where to begin with social media
Where to begin with social mediaWhere to begin with social media
Where to begin with social media
 
3RdTT_SM_Governance_Policy_Creation
3RdTT_SM_Governance_Policy_Creation3RdTT_SM_Governance_Policy_Creation
3RdTT_SM_Governance_Policy_Creation
 
Tools To Measure Social Media Influence
Tools To Measure Social Media InfluenceTools To Measure Social Media Influence
Tools To Measure Social Media Influence
 
Social media metrics and measurement
Social media metrics and measurementSocial media metrics and measurement
Social media metrics and measurement
 
Creating a linked in power profile
Creating a linked in power profileCreating a linked in power profile
Creating a linked in power profile
 
AB1_SelfAssessment_Tests
AB1_SelfAssessment_TestsAB1_SelfAssessment_Tests
AB1_SelfAssessment_Tests
 
#3RdTT_What is a social media aggregation tool
#3RdTT_What is a social media aggregation tool#3RdTT_What is a social media aggregation tool
#3RdTT_What is a social media aggregation tool
 
#3RdTT_What is social media management?
#3RdTT_What is social media management?#3RdTT_What is social media management?
#3RdTT_What is social media management?
 
DrPost_SMStrategy_Map
DrPost_SMStrategy_MapDrPost_SMStrategy_Map
DrPost_SMStrategy_Map
 

Recently uploaded

Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsPaul Groth
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...Sri Ambati
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...CzechDreamin
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxAbida Shariff
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Thierry Lestable
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomCzechDreamin
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesThousandEyes
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...Product School
 

Recently uploaded (20)

Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 

InvisibleWeb-DeeperWeb

  • 2.  What is it?  Visible vs. Invisible  How does it work?  How big is it?  Where is it going?  Invisible Web Search Engines  Invisible Web Databases  Video Training  Resources  References © Michelle Post, Ph.D. 2
  • 3. “Searching on the Internet today can be compared to dragging a net across the surface of the ocean. While a great deal may be caught in the net, there is still a wealth of information that is deep, and therefore, missed. The reason is simple: Most of the Web's information is buried far down on dynamically generated sites, and standard search engines never find it” (Bergman, 2001, para. 2).  “The "visible web" is what you can find using general web search engines. It's also what you see in almost all subject directories. The "invisible web" is what you cannot find using these types of tools” (UC Berkeley Library, n.d., para. 1). © Michelle Post, Ph.D. 3
  • 4. “The deep Web contains 99% of the information content of the Web; however, most of this information is contained in databases and is not indexed by search engines” (Gruchawaka, 2010, para. 1).  “If the most coveted commodity of the Information Age is indeed information, then the value of deep Web content is immeasurable” (Bergman, 2001, para. 5). Michelle Post, Ph.D. 4
  • 5. Surface Web Deep Web Millions of web pages Over 200,000 databases 1 billion documents 550 billion documents 19 terabytes 7,750 terabytes Broad shallow coverage Deep vertical coverage Results contain ads Results contain no ads Content unevaluated Content evaluated by experts (Bergman, 2001) © Michelle Post, Ph.D. 5
  • 6. “The deep Web is qualitatively different from the surface Web. Deep Web sources store their content in searchable databases that only produce results dynamically in response to a direct request” (Bergman, 2001, para. 4). © Michelle Post, Ph.D. 6
  • 7. Public information on the Deep Web is currently 400 to 550 times larger than the commonly defined World Wide Web.  The Deep Web contains 7,500 terabytes of information, compared to 19 terabytes of information in the surface Web.  The Deep Web contains nearly 550 billion individual documents compared to the 1 billion of the surface Web.  More than an estimated 200,000 Deep Web sites presently exist.  Sixty of the largest Deep Web sites collectively contain about 750 terabytes of information – sufficient by themselves to exceed the size of the surface Web by 40 times. (CompletePlanet, n.d., para. 6) Michelle Post, Ph.D. 7
  • 8. “The deep Web is the fastest growing sector of the Web and it appears to be the „paradigm for the next generation Internet‟” (BrightPlanet, 2005, para. 35). © Michelle Post, Ph.D. 8
  • 9. ResourceShelf - http://www.resourceshelf.com/  Direct Search - http://www.freepint.com/gary/direct.htm  Complete Planet - http://www.completeplanet.com/ Michelle Post, Ph.D. 9
  • 10. Listing of Largest Deep Web Sites - http://aip.completeplanet.com/aip- engines/help/largest_engines.jsp  Directory of Open Access Journals - http://www.doaj.org/  Educator's Reference Desk - http://www.eduref.org/  Find Articles - http://www.findarticles.com/  On-Line Encyclopedia of Integer Sequences - http://www.research.att.com/~njas/sequences/  PubMed - http://www.ncbi.nlm.nih.gov/entrez/query.fcgi  Super Searchers Web Page - http://www.infotoday.com/supersearchers/ Michelle Post, Ph.D. 10
  • 11. The Virtual Private Library and Deep Web - http://www.dailymotion.com/video/x9udyo_t he-virtual-private-library-and-dee_news Michelle Post, Ph.D. 11
  • 12. 100 Time-Saving Search Engines for Serious Scholars - http://www.onlineuniversities.com/blog/2010/03/100- time-saving-search-engines-for-serious-scholars/ Deep Web FAQ - http://aip.completeplanet.com/aip- engines/help/help_deepwebfaqs.jsp The Invisible Web Databases - http://www.noodletools.com/debbie/literacies/informatio n/5locate/advicedepth.html Those Dark Hiding Places: The Invisible Web Revealed - http://library.rider.edu/scholarly/rlackie/Invisible/Inv_We b.html White Paper: The Deep Web: Surfacing Hidden Value - http://quod.lib.umich.edu/cgi/t/text/text- idx?c=jep;view=text;rgn=main;idno=3336451.0007.104 Michelle Post, Ph.D. 12
  • 13. Bergman, M. (2001, August). White Paper: The deep web: Surfacing hidden value. The Journal of Electronic Publishing, 7(1), doi: 10.3998/3336451.0007.104. Retrieved from http://quod.lib.umich.edu/cgi/t/text/text- idx?c=jep;view=text;rgn=main;idno=3336451.0007.104 BrightPlanet. (2005). Deep webfaq. Retrieved from http://www.brightplanet.com/ CompletePlanet. (n.d.). How large is the deep web. Retrieved from http://aip.completeplanet.com/aip- engines/help/help_deepwebfaqs.jsp Gruchawka, S. (2010). Using the deep web. Retrieved from http://techdeepweb.com/ UC Berkeley. (n.d.). Invisible or deep web: What it is, how to find it, and Its inherent ambiguity. Retrieved from http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/Invisi bleWeb.html © Michelle Post, Ph.D. 13