Make Google behave: techniques for better results

6,461 views

Published on

Edited version of the presentation given at the UKeiG workshop on 30th October 2013 in London. Covers Google search options and advanced search commands, and Google databases such as Google Finance, Public Data Explorer, Google Finance.

Published in: Technology, News & Politics
1 Comment
1 Like
Statistics
Notes
No Downloads
Views
Total views
6,461
On SlideShare
0
From Embeds
0
Number of Embeds
189
Actions
Shares
0
Downloads
16
Comments
1
Likes
1
Embeds 0
No embeds

No notes for slide

Make Google behave: techniques for better results

  1. 1. Make Google behave: techniques for better results Wednesday, 30th October 2013 London Karen Blakeman, RBA Information Services Karen.Blakeman@rba.co.uk, http://www.rba.co.uk/search/ twitter.com/karenblakeman 29/10/2013 www.rba.co.uk This presentation is licensed under a Creative Commons Attribution 3.0 License1
  2. 2. Google for search? 29/10/2013 http://www.artofeurope.com/prints/ www.rba.co.uk poetical/homer_simpson_poster.htm 2
  3. 3. Problems? Why do we use Google? Often gives 'good enough' results with minimal effort from the searcher Google thinks it knows best when it comes to the search strategy Great coverage Too much information Personalisation Personalisation 29/10/2013 www.rba.co.uk 3
  4. 4. Five things you need to know about Google search 1. Google personalises your search Personalises search based on – – – – – location past search history past browsing activity activity in other areas of Google e.g. YouTube, blogs, images content from contacts in your personal networks may be given priority – what you and others have „liked‟, g+1 29/10/2013 www.rba.co.uk 4
  5. 5. Five things you need to know about Google search 1. Google personalises your search Non-personalised search 29/10/2013 Personalised search www.rba.co.uk 5
  6. 6. Google's Privacy Policy "Our new Privacy Policy makes clear that, if you’re signed in, we may combine information you’ve provided from one service with information from other services. In short, we’ll treat you as a single user across all our products, which will mean a simpler, more intuitive Google experience." "we're more excited than ever to build a seamless social experience, all across Google" Toward a simpler, more beautiful Google http://googleblog.blogspot.co.uk/2012/04/toward-simpler-more-beautifulgoogle.html 29/10/2013 www.rba.co.uk 6
  7. 7. How to “Un-personalise” your search Switch off web/search history Log out of your Google account Clear cookies Use private/incognito browsing 29/10/2013 www.rba.co.uk 7
  8. 8. Private browsing - quickest way “un-personalise”search Chrome - New Incognito window - Ctrl+Shift+N FireFox - File, New Private Window - Ctrl+Shift+P Internet Explorer – Tools, InPrivate Browsing [location varies depending on which version you have] - Ctrl+Shift+P Opera – File, New Private Window - Ctrl+Shift+N Safari – click on Safari next to the Apple symbol in the menu bar, select Private Browsing and then click on OK. Will not remove country personalisation
  9. 9. Five things you need to know about Google search 2. Google automatically looks for variations on your search terms and sometimes drops terms from your search – Google does not tell you it has ignored some of your terms – “..” around terms, phrases, names, titles of documents does not always work – To force an exact match and inclusion of a term in a search prefix it with „intext:‟ public transport intext:algal biofuels – Use Verbatim for an exact match search
  10. 10. Google Verbatim
  11. 11. Five things you need to know about Google search 3. Google web search does not search everything it has in its database – two indexes: main, default index and the supplemental index – supplemental index may contain less popular, unusual, specialist material – supplemental index comes into play when Google thinks your search has returned too few results – Verbatim and some advanced search commands seems to trigger a search in the supplemental index
  12. 12. “Normal search” 1,555,500 29/10/2013 Search after Verbatim is applied 35,500,000 www.rba.co.uk 12
  13. 13. Five things you need to know about Google search 4. Google changes its algorithms several hundred times a year How Google makes improvements to its search algorithm - YouTube http://youtu.be/J5RZOU6vK4Q
  14. 14. Hummingbird Not just an update but a completely new algorithm Tries to make “sense” of your query and put it into context, natural language queries Not just search history but also your location, device being used Announced September 26th 2013 but had already been in use for about a month Many aspects had been tested over the previous months and past year 29/10/2013 www.rba.co.uk 14
  15. 15. Five things you need to know about Google search 5. We are all Google‟s lab rats Just Testing: Google Users May See Up To A Dozen Experiments http://searchengineland.com/just-testing-google-searchers-maysee-up-to-a-dozen-experiments-141570 Mostly minor effects on search but sometimes totally bizarre results Google decides that coots are really lions http://www.rba.co.uk/wordpress/2011/02/12/ google-decides-that-coots-are-really-lions/ Update on coots vs. lions http://www.rba.co.uk/wordpress/2011/02/21/ update-on-coots-vs-lions/
  16. 16. What I see on my screen will not be what you see on your screen, will not be what your colleagues see on theirs, will not be what your users see. Google Scholar more consistent – stuck in a time warp? 29/10/2013 www.rba.co.uk 16
  17. 17. Google gets personal All searches lead to Google+ (they wish!) Emphasis on individuals/authors Author verification – linking Google+ profiles to other network profiles, websites, blogs, social media Travel and local search results displayed in Google+ Searches on locations in Maps – information from Google+ YouTube users forced to set up Google+ profiles [videos made unlisted/private if you refuse] Individuals and businesses “encouraged” to become active on Google+ 29/10/2013 www.rba.co.uk 17
  18. 18. 29/10/2013 www.rba.co.uk 18
  19. 19. Search features are device dependent 29/10/2013 www.rba.co.uk 19
  20. 20. Google Now http://www.google.co.uk/landing/now/ Google Now: Taking the Search Out of Search - Search Engine Watch http://searchenginewatch.com/article/2273399/Google-Now-Taking-the-SearchOut-of-Search 29/10/2013 www.rba.co.uk 20
  21. 21. What does Google know about you Sign in to your Google account and go to http://www.google.com/dashboard Check your ad preferences at www.google.com/ads/preferences If you do not have a Google account there will only be information about you in the right hand column 29/10/2013 www.rba.co.uk 21
  22. 22. Changes to T&Cs 11th November 2013 https://plus.google.com/settings/endorsements?hl=en 29/10/2013 www.rba.co.uk 22
  23. 23. Voice search getting better 29/10/2013 www.rba.co.uk 23
  24. 24. Google Instant Tries to predict what you are searching for as you type, and displays results as you type 29/10/2013 www.rba.co.uk 24
  25. 25. Google Instant Only displays 10 results at a time Disable Google Instant in Search Settings under the cog wheel (upper right hand area of a Google results screen) or go to http://www.google.com/preferences 29/10/2013 www.rba.co.uk 25
  26. 26. Google Knowledge Graph and carousel 29/10/2013 www.rba.co.uk 26
  27. 27. Google carousel 29/10/2013 www.rba.co.uk 27
  28. 28. Google can get it wrong Google "Henry VIII wives": Jane Seymour reveals search engine's blind spots http://www.slate.com/blogs/future_tense/2013/09/23/google_henry_viii_wives_ jane_seymour_reveals_search_engine_s_blind_spots.html Image courtesy of Will Oremus 29/10/2013 www.rba.co.uk 28
  29. 29. Yet more changes! Results page preview with cached copy and similar pages has gone Instead we now have ..... 29/10/2013 www.rba.co.uk 29
  30. 30. Google tries to work out your location Country based on your IP address Town/city based on your IP address/network provider – Google can get this wrong – Google switches between Bristol and Exeter for my location (I‟m in Reading) – Tell Google your location in Search settings (hidden under the cog wheel in the upper right hand area of your results page) 29/10/2013 www.rba.co.uk 30
  31. 31. Country versions of Google and local information Country versions of Google give priority to local content Useful if you are researching a person, company, or sector in another country Go to the relevant country version of Google, for example www.google.fr, www.google.de, www.google.no Google International Domains - List of Country and Language Codes – http://www.distilled.net/blog/uncategorized/google-cctlds-andassociated-languages-codes-reference-sheet/ 29/10/2013 www.rba.co.uk 31
  32. 32. http://www.google.co.uk/ 29/10/2013 www.rba.co.uk 32
  33. 33. http://www.google.no/ 29/10/2013 www.rba.co.uk 33
  34. 34. http://www.google.de/ 29/10/2013 www.rba.co.uk 34
  35. 35. Choosing your search terms Google automatically looks for synonyms and variations on your terms – biofuels will find biodiesel, biogas, bio-ethanol etc. – but do not get the same results if you use biodiesel instead of biofuels – run separate searches using alternative terms – no information on how the synonyms are identified or implemented The terms you use can radically change results – copper mining north wales – copper extraction north wales 29/10/2013 www.rba.co.uk 35
  36. 36. Choosing your search terms 29/10/2013 www.rba.co.uk 36
  37. 37. Google Trends http://www.google.com/trends Compare how often search terms are used over time and by location 29/10/2013 www.rba.co.uk 37
  38. 38. Google Trends http://www.google.com/trends 29/10/2013 www.rba.co.uk 38
  39. 39. Two old tricks that still work Both of these often change the results and the order in which they are presented Repeat important search terms in your search strategy renewable energy biofuels wave wind wind wind Change the order of your terms renewable energy biofuels wave wind wind renewable wave biofuels energy 29/10/2013 www.rba.co.uk 39
  40. 40. Nutrition facts Information from Wikipedia and USDA 29/10/2013 www.rba.co.uk 40
  41. 41. Compare compare spinach with cabbage Do not always need „with‟ Can only compare two similar entities 29/10/2013 www.rba.co.uk 41
  42. 42. Compare 29/10/2013 www.rba.co.uk 42
  43. 43. Google commands "" - around phrases "Metadata mega mess in Google Scholar" to exclude a term Caversham –otago OR to specify alternatives oil OR petroleum (sometimes better to run separate searches) * to stand in for one or more words solar * panels Picks up solar PV panels, solar photovoltaic panels, solar water heating panels 29/10/2013 www.rba.co.uk 43
  44. 44. Google commands Think file format – PDF for research documents, government reports, industry papers, company reports – ppt or pptx for presentations, tracking down an expert on a topic – xls or xlsx for spreadsheets containing data Use the advanced search screen or the filetype: command zeolites environmental remediation filetype:pdf "north sea" deep water drilling filetype:ppt "north sea" deep water drilling filetype:pptx annual average global temperature 1960..2012 filetype:xls annual average global temperature 1960..2012 filetype:xlsx 29/10/2013 www.rba.co.uk 44
  45. 45. Google commands Site search For searching large websites, or groups of sites by type for example government, NHS, academic Can exclude sites using -site: Use advanced search screen or site: command organ donation statistics Wales site:nhs.uk organ donation statistics Wales site:ac.uk organ donation statistics site:wales.gov.uk organ donation statistics Wales -site:au 29/10/2013 www.rba.co.uk 45
  46. 46. Google commands Numeric range search Anything to do with numbers and quantities: years, temperatures, weights, distances, prices etc Use the advanced search screen or type in your two numbers separated by two full stops as part of your search TV advertising spend forecasts 2014..2020 world oil demand forecasts 80..100 mb/d 2015..2030 toblerone 1..5 kg 29/10/2013 www.rba.co.uk 46
  47. 47. Google commands Words in the title – can be single words or phrases Ensures subject is the main focus of the article Use advanced search screen or intitle: intitle:”diabetic retinopathy” Words in the URL – can be single words or phrases Use advanced search screen or inurl: inurl:”diabetic retinopathy” 29/10/2013 www.rba.co.uk 47
  48. 48. define 29/10/2013 www.rba.co.uk 48
  49. 49. Google Reading level Changes the type of material that is returned Nothing to do with publishers assigned reading age Run the search and from the menu above the results select Search tools, All results, Reading level 29/10/2013 www.rba.co.uk 49
  50. 50. Google Reading level Basic 29/10/2013 Advanced www.rba.co.uk 50
  51. 51. Exclusive to Google.com – recipes! 29/10/2013 www.rba.co.uk 51
  52. 52. Date Restrict your results to information that has been published within the last hour, day, week, month, year or your own date range Search tools, Any time and select an option 29/10/2013 www.rba.co.uk 52
  53. 53. daterange: Date restriction does not work with Verbatim Use daterange: command instead Uses Julian date format (fractions omitted) Julian Date Converter http://aa.usno.navy.mil/data/docs/JulianDate.php/ Syntax – for example pages between June 20th and June 26th 2012 talking about the Statoil/Rosneft cooperation daterange:2456098-2456104 Statoil Rosneft 29/10/2013 www.rba.co.uk 53
  54. 54. daterange: the easy way Third party tools for the daterange: search for example http://gmacker.com/web/content/gDateRange/gdr.htm then apply Verbatim 29/10/2013 www.rba.co.uk 54
  55. 55. Searching foreign language pages A significant amount of information is in the local language Google has removed the extremely useful “Translated foreign pages” search option  This is how it can be done now 1. Use Google Translate (http://translate.google.com/) to translate your search into the required language. 2. Copy the translated search and paste it into Google search. 3. Google Chrome will offer to translate page If using another browser click on the „Translate this page‟ link next to a result to view a translation of just that page. 29/10/2013 www.rba.co.uk 55
  56. 56. Google News http://news.google.co.uk/ Can personalise news content when signed in to a Google account. Hidden underneath the cog wheel on the news home page. Change your location (automatically identified by Google), topics covered, sources and frequency of articles from sources. 29/10/2013 www.rba.co.uk 56
  57. 57. Google News Can limit results to a time period. Time options don’t always work in the ‘Archives’ Older material may be priced Can create email and RSS alerts for a search but unreliable 29/10/2013 www.rba.co.uk 57
  58. 58. Google News – advanced search Hidden under the arrow in the search box 29/10/2013 www.rba.co.uk 58
  59. 59. Creating a Google news RSS alert Has Google dumped RSS alerts or not? http://www.rba.co.uk/wordpress/2013/07/15/has-google-dumped-rssalerts-or-not/ 29/10/2013 www.rba.co.uk 59
  60. 60. Google Finance - https://www.google.co.uk/finance 29/10/2013 www.rba.co.uk 60
  61. 61. Google Finance - https://www.google.co.uk/finance 29/10/2013 www.rba.co.uk 61
  62. 62. Google finance historical share prices Can only display and download one year at a time 29/10/2013 www.rba.co.uk 62
  63. 63. Google Public Data Explorer http://www.google.com/publicdata/ One of Google's best kept secrets! 29/10/2013 www.rba.co.uk 63
  64. 64. Google Public Data Explorer 29/10/2013 www.rba.co.uk 64
  65. 65. Blogs Run search and then click on More, followed by Blogs Once blog results are displayed can click on Search tools, Any time and select a time period 29/10/2013 www.rba.co.uk 65
  66. 66. Discussion boards and forums Click on More, Discussions No indication of how discussions and forums are identified 29/10/2013 www.rba.co.uk 66
  67. 67. Google Videos Not the same as YouTube Google Video 29/10/2013 YouTube www.rba.co.uk 67
  68. 68. http://docutu.be/ 29/10/2013 www.rba.co.uk 68
  69. 69. Images - copyright Always, always check and double check the copyright - images may have a digital watermark and be tracked e.g. Digimarc Creative Commons does not mean you can do what you like with an image – http://creativecommons.org/licenses/ “Open-licencing your images. What it means and how to do it.” Andy Mabbett aka pigsonthewing – http://pigsonthewing.org.uk/open-licencing-images-what-how/ Karen Blakeman's Blog “Free-to-use images might not be” – http://www.rba.co.uk/wordpress/2009/07/16/free-to-use-imagesmight-not-be/ 29/10/2013 www.rba.co.uk 69
  70. 70. Images – “free to use....” Google advanced image search - use the usage rights, but always double check the licence on the web site Licence may be assigned to another image on the page rather than the one you want to use 29/10/2013 www.rba.co.uk 70
  71. 71. Images 29/10/2013 www.rba.co.uk 71
  72. 72. Images – “all sizes” 29/10/2013 www.rba.co.uk 72
  73. 73. Images – use an existing image Click on the camera icon in the search box and then either enter the URL of an image or upload the image 29/10/2013 www.rba.co.uk 73
  74. 74. Google Art Project http://www.googleartproject.com/ 29/10/2013 www.rba.co.uk 74
  75. 75. Google ArtProject Museum view 29/10/2013 www.rba.co.uk 75
  76. 76. Google Maps Post code areas, locations, directions Public transport for some countries Cycle routes for some areas Estimated fuel costs Satellite, Street View, photos, weather, videos Only as good as the underlying data – double check location 29/10/2013 www.rba.co.uk 76
  77. 77. Google Maps directions from....to... 29/10/2013 www.rba.co.uk 77
  78. 78. Google Scholar http://scholar.google.com/ “Google Scholar provides a simple way to broadly search for scholarly literature. From one place, you can search across many disciplines and sources: articles, theses, books, abstracts and court opinions, from academic publishers, professional societies, online repositories, universities and other web sites. Google Scholar helps you find relevant work across the world of scholarly research”. • Search all scholarly literature from one convenient place • Explore related works, citations, authors, and publications • Locate the complete document through your library or on the web • Keep up with recent developments in any area of research • Check who's citing your publications, create a public author profile 29/10/2013 www.rba.co.uk 78
  79. 79. Google Scholar Does not cover all key journals in all subjects – no source list Top publications for subjects and languages under Metrics link on home page or http://scholar.google.co.uk/citations?view_op=top_venues&hl=en Scholar indexes the full text but you may have to pay to view the whole article Groups different versions of an article together 29/10/2013 www.rba.co.uk 79
  80. 80. Google Scholar Includes open access material, pre-prints, institutional repositories (but not necessarily author self archived repositories) Includes material that is NOT peer reviewed but is structured and looks like an academic article (title in large font, authors, affiliations, abstract, keywords, citations) Pre-prints and IR copies may differ from final published version – charts and images may be redacted because of copyright restrictions 29/10/2013 www.rba.co.uk 80
  81. 81. Google Scholar Does NOT use the publishers‟ metadata Date and author search looks in the area of the document where those elements are usually found Page numbers, part of an address, data item may be mistaken for publication year Sometimes gets the author wrong 29/10/2013 www.rba.co.uk 81
  82. 82. Jacsó, Péter. “Metadata mega mess in Google Scholar.” Online Information Review 34.1 (2010): 175-191. Jacsó, Péter. Newswire Analysis: Google Scholar‟s Ghost Authors, Lost Authors, and Other Problems http://www.libraryjournal.com/article/CA6698580.html Jacsó, Péter. “Google Scholar Author Citation Tracker: is it too little, too late? “Online Information Review 36.1 (2012): 126-141. Jacsó, Péter. “Using Google Scholar for journal impact factors and the h-index in nationwide publishing assessments in academia–siren songs and air-raid sirens.” Online Information Review 36.3 (2012): 462-478. Jacso – Savvy Searching Columns, Online Information Review http://www2.hawaii.edu/~jacso/savvy-mcb.htm 29/10/2013 www.rba.co.uk 82
  83. 83. Bad Google Scholar Results | Academic Librarian https://blogs.princeton.edu/librarian/2012/10/bad-google-scholar-results/ Gray, Jerry E., et al. Scholarish: Google Scholar and its Value to the Sciences. Issues in Science and Technology Librarianship. Summer 2012 http://www.istl.org/12-summer/article1.html Hamilton, Michelle C, Janz, Margaret M and Hauser, Alexandra. Can librarians trust resources found on Google Scholar? Yes… and no. Impact of Social Sciences: Maximizing the impact of academic research .17 September 2012. http://blogs.lse.ac.uk/impactofsocialsciences/2012/09/17/can-science-students-andresearchers-trust-resources-found-on-google-scholar-yes-and-no/ Kramer, Bianca and Sieverts, Eric. Beyond coverage #ili2012. Slideshare. 27 October 2012. http://www.slideshare.net/bmkramer/beyond-coverage-ili2012 HLWIKI International. Google scholar bibliography. UBC HealthLib Wiki - A Knowledge-Base for Health Librarians. http://hlwiki.slais.ubc.ca/index.php/Google_scholar_bibliography 29/10/2013 www.rba.co.uk 83
  84. 84. Google Scholar advanced search commands Use advanced search screen or commands as follows: + sign before a search term to force an exact match, for example +norne “....” around phrases for example “environmental remediation” intitle: to search for a single word in the title, for example intitle:zeolites environmental remediation allintitle: to search for all of your terms in the title, for example allintitle:zeolites environmental remediation author: to search on an author‟s name, for example zeolites environmental remediation author:rhodes site: to limit your search to specific institution for example marcellus shale site:psu.edu Commands can be combined for a precise search, for example author:wolford site:psu.edu allintitle:marcellus shale 29/10/2013 www.rba.co.uk 84
  85. 85. Patents https://www.google.com/patents Coverage: – – – – – – US Canada European Patent Office (EPO) Germany China World Intellectual Property Organisation (WIPO) Patents available in original language and English (Google Translate) 29/10/2013 www.rba.co.uk 85
  86. 86. Google Patents 29/10/2013 www.rba.co.uk 86
  87. 87. Google Patents advanced search https://www.google.co.uk/advanced_patent_search 29/10/2013 www.rba.co.uk 87
  88. 88. Patents – Prior Art Finder http://www.google.com/patents/related 29/10/2013 www.rba.co.uk 88
  89. 89. Google Patents Patent Searching 101: A Patent Search Tutorial IPWatchdog.com Patents & Patent Law http://www.ipwatchdog.com/2012/03/17/patent-searching-101-apatent-search-tutorial/id=22851/ Compares Google patent search with other services “Holes in the database” – may not be able to find patents you know exist Does go back further than some e.g. to US patent no.1 but difficult to focus search See also Patents Searching with Esp@cenet, Google Patents and USPTO - University of Bradford http://www.brad.ac.uk/library/resources/patents-searching-withespacenet-google-patents-and-uspto/ 29/10/2013 www.rba.co.uk 89
  90. 90. books.google.com Or use the Books option under More on the results page. Includes magazines, journals, newspapers 29/10/2013 www.rba.co.uk 90
  91. 91. Google Books Ngram viewer http://books.google.com/ngrams/ 29/10/2013 www.rba.co.uk 91
  92. 92. Constitute https://www.constituteproject.org/ “The world‟s constitutions to read, search and compare” Supported by Google Ideas See http://comparativeconstitutionsproject.org/ for background and who is involved 29/10/2013 www.rba.co.uk 92
  93. 93. Create your own Google custom search engine http://www.google.com/cse/ For – regularly searched sites – selected sites on a subject or type of organisation Cannot include password protected sources or sites where you have to fill in a form to access the information Google's blog on custom search http://googlecustomsearch.blogspot.com/ 29 October 2013 Karen Blakeman www.rba.co.uk 93
  94. 94. Google‟s free alerting services Google email and RSS alerts are seriously broken – – – – do not alert you to everything that is new alerts sometimes „die‟ often bring up old material that you‟ve already seen duplicate information Email alerts becoming a rarity – some web sites and blogs offer email subscription to new content – often use RSS to email conversion tools such as Feedburner (how long will that be around?) Need an RSS reader e.g. Netvibes, Feedly, FeedReader, Old Reader – Phil Bradley's weblog: 20 Alternatives to Google Reader – http://philbradley.typepad.com/phil_bradleys_weblog/2013/03/20 -alternatives-to-google-reader.html 29/10/2013 www.rba.co.uk 94
  95. 95. Keeping up to date Inside Search http://insidesearch.blogspot.com/ Official Google Blog http://googleblog.blogspot.com/ Google Scholar Blog http://googlescholar.blogspot.com/ SearchReSearch : http://searchresearch1.blogspot.co.uk/ Search Engine Land http://searchengineland.com/ Search Engine Watch http://searchenginewatch.com/ Karen Blakeman‟s Blog http://www.rba.co.uk/wordpress/ Phil Bradley's weblog http://philbradley.typepad.com/ 29/10/2013 www.rba.co.uk 95
  96. 96. Fact sheets The fact sheets are available at http://www.rba.co.uk/search/ Search Strategies - Top Search Tips – http://www.rba.co.uk/search/TopSearchTips.shtml Search Strategies - Selected Google Commands – http://www.rba.co.uk/search/SelectedGoogleCommands.shtml Search Strategies - Google Search Tips – http://www.rba.co.uk/search/GoogleSearchTips.shtml Search Strategies - Search Tools Summary and Comparison – http://www.rba.co.uk/search/compare.shtml 29/10/2013 www.rba.co.uk 96
  97. 97. 1. Remember that Google is continually changing 2. Personalisation is a key element of Google‟s algorithms 3. Explore and make use of the options in the menus on your results pages 4. Get to know the advanced search commands 5. If you want to keep Google in check keep up with changes and new developments at Google 29/10/2013 www.rba.co.uk 97

×