Download to read offline
Uploaded byChakrit Phain
Web Scraping with Python
This document discusses web scraping techniques using Python, including HTTP programming, DOM parsing, and regular expressions. It covers HTTP requests and responses, using common HTTP methods like GET and POST, managing cookies and sessions, and tools for debugging HTTP requests. Python is presented as a programming language that can be used for web scraping by utilizing these techniques to extract and parse data from websites.
More Related Content
Similar to Web Scraping with Python
Web Scraping with Python
- 1. Web Scraping withPython Softnix Technology Chakrit Phain
- 2. Topic HTML parsing HTTP Programming Methods CookieSession HTTP Tools Chrome Develop Tool Postman Python Web Scraping Regular Expression DOM parsing
- 3. • HTTP programming •DOM parsing • Text pattern matching (Regular Expression) • Etc. Web Scraping technique https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming
- 4.
- 5. Methods • Get • Post CookieSession HTTP Programming https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming
- 6. HTTP Request &Response https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming GET /index.html HTTP/1.1 Host: www.example.com HTTP/1.1 200 OK Date: Mon, 23 May 2005 22:38:34 GMT Content-Type: text/html; charset=UTF-8 Content-Encoding: UTF-8 Content-Length: 138 Last-Modified: Wed, 08 Jan 2003 23:11:55 GMT Server: Apache/1.3.3.7 (Unix) (Red- Hat/Linux) ETag: "3f80f-1b6-3e1cb03b" Accept-Ranges: bytes Connection: close <html> <head> <title>An Example Page</title> </head> <body> Hello World, this is a very simple HTML document. </body> </html> Request Response
- 7. Hand On #1http telnet (5mins)
- 8.
- 9.
- 10.
- 11.
- 12. Hand On #2Session Hijack (5mins)
- 13.