Download to read offline
![DOMXPath
Path Expression Description
bookstore Selects all nodes with the name "bookstore"
/bookstore Selects from the root node
bookstore/book Selects all book elements that are children of bookstore
//book Selects all book elements no matter where they are in the document
bookstore//book Selects all book elements that are descendant of the bookstore element, no matter
where they are under the bookstore element
//@lang Selects all attributes that are named lang
/bookstore/book[1] Selects the first book element that is the child of the bookstore element.](https://image.slidesharecdn.com/webextractphpxpath-230828034030-8c0ab4a2/85/Web-scraping-with-php-28-320.jpg)
![DOM Example
//article/div[2]/div[7]//a](https://image.slidesharecdn.com/webextractphpxpath-230828034030-8c0ab4a2/85/Web-scraping-with-php-30-320.jpg)
Uploaded byChakrit Phain
Web scraping with php
The document discusses web data extraction using PHP, focusing on various methods including HTTP programming, DOM parsing, and text pattern matching. It outlines techniques for accessing and retrieving data from various web sources, illustrating with examples of HTTP requests and DOM manipulation. Key tools and functions such as fopen, file_get_contents, and cURL are highlighted for extracting HTML content.
More Related Content
![[PyConZA 2017] Web Scraping: Unleash your Internet Viking](https://cdn.slidesharecdn.com/ss_thumbnails/slides-171005083629-thumbnail.jpg?width=640&height=640&fit=bounds)
Web scraping with php
- 1. Web data extractionwith PHP Chakrit Phain Softnix Technology Co.,Ltd.
- 2.
- 3. Topic HTTP Programming • Methods •Cookie • Session HTTP Tools • Chrome Develop tool • Postman HTTP access with PHP • Fopen • File_get_contents • Curl HTML access with DOM PHP I/O Stream
- 4. • Data extractionis the act or process of retrieving data out of (usually unstructured or poorly structured) data sources for further data processing or data storage (data migration). https://en.wikipedia.org/wiki/Data_extraction
- 5. Techniques • HTTP programming •DOM parsing • Text pattern matching (Regular expression) • Etc. https://en.wikipedia.org/wiki/Web_scraping
- 6. HTTP Programming • Methods • Get •Post • Cookie • Session
- 7. HTTP Request & Response GET /index.htmlHTTP/1.1 Host: www.example.com HTTP/1.1 200 OK Date: Mon, 23 May 2005 22:38:34 GMT Content-Type: text/html; charset=UTF-8 Content-Encoding: UTF-8 Content-Length: 138 Last-Modified: Wed, 08 Jan 2003 23:11:55 GMT Server: Apache/1.3.3.7 (Unix) (Red- Hat/Linux) ETag: "3f80f-1b6-3e1cb03b" Accept-Ranges: bytes Connection: close <html> <head> <title>An Example Page</title> </head> <body> Hello World, this is a very simple HTML document. </body> </html>
- 8. Hand On #1http telnet
- 9. Hand On #1 GET/ HTTP/1.1 Host: testing-ground.scraping.pro HTTP/1.1 200 OK Date: Fri, 18 May 2018 05:17:36 GMT Server: Apache/2.2.22 (Debian) X-Powered-By: PHP/5.4.4-14+deb7u12 Vary: Accept-Encoding Content-Length: 3701 Content-Type: text/html
- 10.
- 11.
- 12.
- 13. Hand On #2http cookie
- 14.
- 15. How to gethtml content with PHP •fopen() •file_get_contents() •curl
- 16.
- 17. Hand On #3Fopen
- 18.
- 19. Hand On #4File_get_contents
- 20.
- 21. Hand On #5CURL
- 22.
- 23. HTML DOM Access • getElementById •getElementByTagName • DOMXPath
- 24.
- 25.
- 26. PHP DOM CLASS TYPE •DOMDocument • Represents an entire HTML or XML document • DOMNodeList • The NodeList object represents an ordered list of nodes • DOMNode • Each of DOMNodeList • DOMElement • Extend DOMNode
- 27. DOMXPath Expression Description nodename Selectsall nodes with the name "nodename" / Selects from the root node // Selects nodes in the document from the current node that match the selection no matter where they are . Selects the current node .. Selects the parent of the current node @ Selects attributes
- 28. DOMXPath Path Expression Description bookstoreSelects all nodes with the name "bookstore" /bookstore Selects from the root node bookstore/book Selects all book elements that are children of bookstore //book Selects all book elements no matter where they are in the document bookstore//book Selects all book elements that are descendant of the bookstore element, no matter where they are under the bookstore element //@lang Selects all attributes that are named lang /bookstore/book[1] Selects the first book element that is the child of the bookstore element.
- 29.
- 30.
- 31. Hand On #6IMDB
- 32.