Screaming frog + xpath en

Sabine Langmann

•2 likes•1,185 views

Level 1
23.08.2018 Sabine Langmann Bit.ly/abjsd

What is this about?
23.08.2018 Sabine Langmann Bit.ly/abjsd

We‘d like: to crawl specific
elements on our own web pages
or the ones of our competition
We use: Screaming Frog‘s
Custom Search + XPath
23.08.2018 Sabine Langmann Bit.ly/abjsd

Level 2
23.08.2018 Sabine Langmann Bit.ly/abjsd

Who am I?
Geek. SEO. Kuchen.
23.08.2018 Sabine Langmann Bit.ly/abjsd

Who am I?
http://sabine-langmann.com
https://www.linkedin.com/in/sabine-langmann/
@SabTheLa
@sababeille
23.08.2018 Sabine Langmann Bit.ly/abjsd

Slides available at:
https://www.slideshare.net/SabineLangmann
23.08.2018 Sabine Langmann Bit.ly/abjsd

Level 3Level 3
23.08.2018 Sabine Langmann Bit.ly/abjsd

Xpath
23.08.2018 Sabine Langmann Bit.ly/abjsd

XPath (XML Path Language) is a
query language
for selecting nodes
from an XML document.
Wikipedia
23.08.2018 Sabine Langmann Bit.ly/abjsd

Simple Syntax
node every page element (e.g. H2, a, p, div)
// adresses a certain node
attribute attribute of a node (e.g. class, id)
@ adresses a certain attribute
count() counts addressed nodes
23.08.2018 Sabine Langmann Bit.ly/abjsd

Simple Syntax
23.08.2018 Sabine Langmann
//node[@attribute="attribute_name"]
bit.ly/2o3vJ5O

Simple Syntax
23.08.2018 Sabine Langmann
count(//node[@attribute="attribute_name"])
bit.ly/2o3vJ5O

Level 4
23.08.2018 Sabine Langmann Bit.ly/abjsd

Some use cases
23.08.2018 Sabine Langmann Bit.ly/abjsd

Urlaubspiraten
vs.
Sonnenklar TV
23.08.2018 Sabine Langmann Bit.ly/abjsd

How many images?
How many H2, H3, etc?
How many words?
How many links to which pages?
23.08.2018 Sabine Langmann Bit.ly/abjsd

23.08.2018 Sabine Langmann Bit.ly/abjsd
How many images?
How many H2, H3, etc?
How many words?
How many links to which pages?

Step #1
23.08.2018 Sabine Langmann Bit.ly/abjsd

23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #1

23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #2

What am I searching for?
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #3

In
<div class="htmlContent">
I‘m searching for links, which is
<a>-Tags
23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #3

Suitable Xpath selector:
//div[@class ="htmlContent"]//a
23.08.2018 Sabine Langmann Bit.ly/abjsd
3. Schritt

23.08.2018 Sabine Langmann Bit.ly/abjsd
Step #4

23.08.2018 Sabine Langmann Bit.ly/abjsd
Result

Result
23.08.2018 Sabine Langmann Bit.ly/abjsd

usw.23.08.2018 Sabine Langmann Bit.ly/abjsd

In
<div class="container">
I‘m searching for
the number of H3
23.08.2018 Sabine Langmann Bit.ly/abjsd

Suitable Xpath selector:
count(//div[@class ="container"]//h3)
23.08.2018 Sabine Langmann Bit.ly/abjsd

Gutscheinsammler
vs.
Sparwelt
23.08.2018 Sabine Langmann Bit.ly/abjsd

Which star rating?
How many words in the intro?
How many active coupon codes?
23.08.2018 Sabine Langmann Bit.ly/abjsd

Suitable Xpath selector:
//button[@data-vouchertype="is__discounts"]//span
23.08.2018 Sabine Langmann Bit.ly/abjsd

How many active coupon codes?
23.08.2018 Sabine Langmann Bit.ly/abjsd

Suitable Xpath selector:
count(
//div[@class="media-list vouchers-active"]
//div[@class="col-xs-12 col-sm-5"]
//span[@class="text"]
)
23.08.2018 Sabine Langmann Bit.ly/abjsd

Kino.de
vs.
Serienjunkies
23.08.2018 Sabine Langmann Bit.ly/abjsd

How many words in the description?
23.08.2018 Sabine Langmann Bit.ly/abjsd

Suitable Xpath selector:
//section[@class="smb-post-body"]//p
23.08.2018 Sabine Langmann Bit.ly/abjsd

Suitable Xpath selector:
//section//p
23.08.2018 Sabine Langmann Bit.ly/abjsd

Level 5
23.08.2018 Sabine Langmann Bit.ly/abjsd

Recap:
Which data do I need?
Can I crawl the respective elements?
What is the right Xpath selector?
That‘s it!
23.08.2018 Sabine Langmann Bit.ly/abjsd

Screaming frog + xpath en

•2 likes•1,185 views

Download to read offline

Marketing

#SEO4Pirates Nr.6 How to crawl specific page elements using Screaming Frog and XPath English version

Sabine Langmann

What's hot

Boston Area SharePoint Users Group November 9th, 2011 Meeting Boston Area SharePoint Users Group

269 views•27 slides

4/13/11 Boston Area SharePoint Users Group Meeting Boston Area SharePoint Users Group

300 views•33 slides

7/14/10 Boston Area SharePoint Users Group Meeting Boston Area SharePoint Users Group

362 views•26 slides

2/9/11 Boston Area SharePoint Users Group Meeting Boston Area SharePoint Users Group

258 views•29 slides

Sistrix - SEO Do's and Don't Amazon Associates UK

353 views•42 slides

BASPUG Meeting deck from 7/11/12 Boston Area SharePoint Users Group

453 views•35 slides

What's hot(9)

Boston Area SharePoint Users Group November 9th, 2011 Meeting

Boston Area SharePoint Users Group•269 views

4/13/11 Boston Area SharePoint Users Group Meeting

Boston Area SharePoint Users Group•300 views

7/14/10 Boston Area SharePoint Users Group Meeting

Boston Area SharePoint Users Group•362 views

2/9/11 Boston Area SharePoint Users Group Meeting

Boston Area SharePoint Users Group•258 views

Sistrix - SEO Do's and Don't

Amazon Associates UK•353 views

BASPUG Meeting deck from 7/11/12

Boston Area SharePoint Users Group•453 views

Telling the Story of Your Content - SAScon 2016

Chris Green•380 views

MAA Southeast Section Picture Slideshow

Jon Ernstberger•246 views

Boston Area SharePoint Users Group January 11th, 2012 Meeting

Boston Area SharePoint Users Group•257 views

Recently uploaded

B2B Lead Generation - Driving Sales from Marketing - Anet (de Kock) van Stade...DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

31 views•54 slides

Driving value from first-party data in a privacy-centric world - Vimal Badian...DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

47 views•32 slides

Understanding Your Consumer Through Data - Hiram Enriquez & Katie Mack, Amazo...DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

32 views•30 slides

Data Sources to Produce Better Organic Visibility - Nick Kruger, Ogilvy SA DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

31 views•27 slides

Growing The Small To Medium E-commerce Enterprise Market - Chanel Hardman, Us...DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

34 views•10 slides

social media marketing tips aysh2afidha

35 views•1 slide

Recently uploaded(20)

B2B Lead Generation - Driving Sales from Marketing - Anet (de Kock) van Stade...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•31 views

Driving value from first-party data in a privacy-centric world - Vimal Badian...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•47 views

Understanding Your Consumer Through Data - Hiram Enriquez & Katie Mack, Amazo...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•32 views

Data Sources to Produce Better Organic Visibility - Nick Kruger, Ogilvy SA

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•31 views

Growing The Small To Medium E-commerce Enterprise Market - Chanel Hardman, Us...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•34 views

social media marketing tips

aysh2afidha•35 views

Social Media Marketing Master Class - Uptin Saiidi, Up10 Media

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•49 views

Growing Beyond Expectations, 10 Marketing Lessons From Hyper-growth Companies...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•28 views

Revolutionizing Marketing - Harnessing the Power of AI - Michael Letschin, Brevo

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•31 views

Panel - Digital Marketing Trends Experts Insights on How to Gain a Competitiv...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•18 views

The Art and Science of Data-Driven Creativity (in Advertising) - Ken Gamage, ...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•18 views

How Brands Are Making Better Digital Marketing Decisions - Neil Pursey, Measu...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•31 views

The Modern Content Challenge - Charlie Bell, Contentful

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•49 views

Panel - Digital Marketing in the New Era of Privacy & Data Governance - Ashle...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•32 views

Customer Experience Master Class - Hazem El Zayat, Ogilvy

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•48 views

How To Build Digital Marketing Strategies - Kuralay Assainova, Liana Technolo...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•52 views

Digital Marketing Trends - Kuralay Assainova, Liana Technologies

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•48 views

Building A Content Engine For Scale - Eda Kavlakoglu, IBM

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•34 views

Harnessing the power of FREE behavioral analytics with Microsoft Clarity - Ah...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•32 views

Retail Trends in 2023 How The Economy And Consumers Will Continue To Shape Th...

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions•32 views

Screaming frog + xpath en

1. Screaming Frog + Xpath Crawl specific page elements on your own or competitor‘s websites @Urlaubspiraten #SEO4Pirates Nr.6 Sabine Langmann

2. Level 1 23.08.2018 Sabine Langmann Bit.ly/abjsd

3. What is this about? 23.08.2018 Sabine Langmann Bit.ly/abjsd

4. We‘d like: to crawl specific elements on our own web pages or the ones of our competition We use: Screaming Frog‘s Custom Search + XPath 23.08.2018 Sabine Langmann Bit.ly/abjsd

5. 23.08.2018 Sabine Langmann Bit.ly/abjsd

6. 23.08.2018 Sabine Langmann Bit.ly/abjsd

7. 23.08.2018 Sabine Langmann Bit.ly/abjsd

8. 23.08.2018 Sabine Langmann Bit.ly/abjsd

9. Level 2 23.08.2018 Sabine Langmann Bit.ly/abjsd

10. Who am I? Geek. SEO. Kuchen. 23.08.2018 Sabine Langmann Bit.ly/abjsd

11. Who am I? http://sabine-langmann.com https://www.linkedin.com/in/sabine-langmann/ @SabTheLa @sababeille 23.08.2018 Sabine Langmann Bit.ly/abjsd

12. Slides available at: https://www.slideshare.net/SabineLangmann 23.08.2018 Sabine Langmann Bit.ly/abjsd

13. Level 3Level 3 23.08.2018 Sabine Langmann Bit.ly/abjsd

14. Xpath 23.08.2018 Sabine Langmann Bit.ly/abjsd

15. XPath (XML Path Language) is a query language for selecting nodes from an XML document. Wikipedia 23.08.2018 Sabine Langmann Bit.ly/abjsd

16. Simple Syntax node every page element (e.g. H2, a, p, div) // adresses a certain node attribute attribute of a node (e.g. class, id) @ adresses a certain attribute count() counts addressed nodes 23.08.2018 Sabine Langmann Bit.ly/abjsd

17. Simple Syntax 23.08.2018 Sabine Langmann //node[@attribute="attribute_name"] bit.ly/2o3vJ5O

18. Simple Syntax 23.08.2018 Sabine Langmann count(//node[@attribute="attribute_name"]) bit.ly/2o3vJ5O

19. Level 4 23.08.2018 Sabine Langmann Bit.ly/abjsd

20. Some use cases 23.08.2018 Sabine Langmann Bit.ly/abjsd

21. Urlaubspiraten vs. Sonnenklar TV 23.08.2018 Sabine Langmann Bit.ly/abjsd

22. 23.08.2018 Sabine Langmann Bit.ly/abjsd

23. How many images? How many H2, H3, etc? How many words? How many links to which pages? 23.08.2018 Sabine Langmann Bit.ly/abjsd

24. 23.08.2018 Sabine Langmann Bit.ly/abjsd

25. 23.08.2018 Sabine Langmann Bit.ly/abjsd How many images? How many H2, H3, etc? How many words? How many links to which pages?

26. Step #1 23.08.2018 Sabine Langmann Bit.ly/abjsd

27. 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #1

28. 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #2

29. 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #2

30. What am I searching for? 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #3

31. In <div class="htmlContent"> I‘m searching for links, which is <a>-Tags 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #3

32. Suitable Xpath selector: //div[@class ="htmlContent"]//a 23.08.2018 Sabine Langmann Bit.ly/abjsd 3. Schritt

33. 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #4

34. 23.08.2018 Sabine Langmann Bit.ly/abjsd Step #4

35. 23.08.2018 Sabine Langmann Bit.ly/abjsd

36. 23.08.2018 Sabine Langmann Bit.ly/abjsd Result

37. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

38. 23.08.2018 Sabine Langmann Bit.ly/abjsd

39. 23.08.2018 Sabine Langmann Bit.ly/abjsd

40. usw.23.08.2018 Sabine Langmann Bit.ly/abjsd

41. 23.08.2018 Sabine Langmann Bit.ly/abjsd

42. 23.08.2018 Sabine Langmann Bit.ly/abjsd

43. In <div class="container"> I‘m searching for the number of H3 23.08.2018 Sabine Langmann Bit.ly/abjsd

44. Suitable Xpath selector: count(//div[@class ="container"]//h3) 23.08.2018 Sabine Langmann Bit.ly/abjsd

45. 23.08.2018 Sabine Langmann Bit.ly/abjsd

46. 23.08.2018 Sabine Langmann Bit.ly/abjsd Result

47. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

48. Gutscheinsammler vs. Sparwelt 23.08.2018 Sabine Langmann Bit.ly/abjsd

49. 23.08.2018 Sabine Langmann Bit.ly/abjsd

50. Which star rating? How many words in the intro? How many active coupon codes? 23.08.2018 Sabine Langmann Bit.ly/abjsd

51. 23.08.2018 Sabine Langmann Bit.ly/abjsd

52. Suitable Xpath selector: //button[@data-vouchertype="is__discounts"]//span 23.08.2018 Sabine Langmann Bit.ly/abjsd

53. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

54. 23.08.2018 Sabine Langmann Bit.ly/abjsd

55. How many active coupon codes? 23.08.2018 Sabine Langmann Bit.ly/abjsd

56. 23.08.2018 Sabine Langmann Bit.ly/abjsd

57. 23.08.2018 Sabine Langmann Bit.ly/abjsd

58. Suitable Xpath selector: count( //div[@class="media-list vouchers-active"] //div[@class="col-xs-12 col-sm-5"] //span[@class="text"] ) 23.08.2018 Sabine Langmann Bit.ly/abjsd

59. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

60. Kino.de vs. Serienjunkies 23.08.2018 Sabine Langmann Bit.ly/abjsd

61. 23.08.2018 Sabine Langmann Bit.ly/abjsd

62. How many words in the description? 23.08.2018 Sabine Langmann Bit.ly/abjsd

63. Suitable Xpath selector: //section[@class="smb-post-body"]//p 23.08.2018 Sabine Langmann Bit.ly/abjsd

64. 23.08.2018 Sabine Langmann Bit.ly/abjsd

65. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

66. 23.08.2018 Sabine Langmann Bit.ly/abjsd

67. How many words in the description? 23.08.2018 Sabine Langmann Bit.ly/abjsd

68. Suitable Xpath selector: //section//p 23.08.2018 Sabine Langmann Bit.ly/abjsd

69. 23.08.2018 Sabine Langmann Bit.ly/abjsd

70. Result 23.08.2018 Sabine Langmann Bit.ly/abjsd

71. Level 5 23.08.2018 Sabine Langmann Bit.ly/abjsd

72. Recap: Which data do I need? Can I crawl the respective elements? What is the right Xpath selector? That‘s it! 23.08.2018 Sabine Langmann Bit.ly/abjsd

Screaming frog + xpath en

Screaming frog + xpath en

Recommended

More Related Content

What's hot

What's hot(9)

Recently uploaded

Recently uploaded(20)

Screaming frog + xpath en