Search Engine Optimization and OSINT What is it all about? And how can it help me?
Data, Data, Data Resulting in nearly 8 years of content uploaded every day! 5,000 years ago People started to write 600 years ago People started to publish 43 years ago The internet was born 17 years ago The World Wide Web was invented Over 10 million web pages are added to the internet everyday! The current Indexed Web contains at least 7.46 billion pages!
Open Source:Data, Information & Intelligence • OSD: Data • OSI: Information • OSINT: Intelligence
Publicly Available MaterialInternet Traditional Mass Media - TV - Radio, Geospatial Information - Newspapers - Maps - Magazines, etc… - Commercial Imagery Products - Conferences - Specialized Journals - Think Tank Studies
Open Source Data (OSD)Data is the raw print, broadcast, oral debriefing, or otherform of information from a primary source.It can be a photograph, a tape recording, a commercialsatellite image, or a personal letter from an individual.ex: reporter embedded with forces in Afghanistan or Iraq.Taking pictures, talking to soldiers, recording conversationsand firefights, and taking notes with a pen or pencil.This is considered raw data until it goes through aconversion process to create a coherent product.
Open Source Information (OSI)OSI is comprised of the raw data that can be put together, generally by aneditorial process that provides some filtering and validation as well aspresentation management.OSI is generic information that is usually widely disseminated.Newspapers, books, broadcasts, and general daily reports are part of the OSIworld.Ex: a reporter embedded with forces who takes the raw data and converts it intoa meaningful article that is printed in newspapers, magazines or broadcastedover the air waves. OSI is what a Soldier would purchase at the bookstore insidethe Post Exchange in the form of USA Today or Newsweek.
Open Source Intelligence (OSINT)OSINT is information that has been deliberately discovered, discriminated,distilled, and disseminated to a select audience, generally the commander andhis/her immediate staff, in order to address a specific question.In the case of a battlefield commander, it would more than likely be answering thepriority intelligence requirements (PIR) or specific orders or requests (SOR).OSINT, in other words, applies the proven process of intelligence to the broaddiversity of open sources of information, and creates intelligence.Example: The meaningful article above (OSI) that was created from raw data isused to support an operation. It’s quite possible that a photo accompanying thearticle may be of a house known to harbor insurgents. The photo in the articleidentifies the location and now can be used to support a tailored operation toattack the insurgents.
Don’t Let Limit YouPre-existing research/analysis limitations Hyper-Personalization Language Barrier Lack of Cultural Knowledge creates the Cultural Intelligence “Filter Bubble” Data Unsearchable UnavailableProblem: Unsolicited Search FilterAlgorithmic LimitationsBased on 57 signalsEx: • Location • Language • Sign-In • Computer Model • Browser Eli Pariser – “The Filter Bubble”
Moving Beyond: Academic Journal Search Engines/Databases Carnegie EndowmentJstor Brookings InstitutionEBSCOHost EIUProQuest RANDLexisNexis International Crisis GroupAcademic Search Premier International Institute for Strategic Studies German Institute for International Politics Japan Institute of International Affairs Recommended: Search Engine Optimization Extensions ext:pdf site:www.THINKTANK.com Dates: 2000..2010 -Minus and/or +Plus things in or out
Alternatives to the Google Search Engine: Cluster Based Searches Over 85% of everyday searches return different results when you use different search engines such as Google, Yahoo, Bing and Ask.DogPile Performs multiple searchesand then aggregates the results intoone quality set of results.Goal: to give universal results insteadof what one engine thinks may be bestsuited for you. www.dogpile.com * Has advanced search
Alternatives to the Google Search Engine: Cluster Based SearchesYippy (formerly known as Clusty)Ex: Searching for articles and material relating to OSINT.Instead of doing many different searches, just search forOSNT and Yippy will gather them into aggregated clustergroups based on the results; and also show results inthe traditional format - descending in order of relevance.Goal: Organize search results into clustered themes, www.yippy.comtopics and sources. * Has advanced search Quintura Redefines how search results should be displayed using a tag cloud as well as the traditional descending in order of relevance results. Hovering your mouse over the cloud will show alternative options. [method is used to display results for web, images and videos.] Goal: Quicker alternative display using cloud of themed key words www.quintura.com