1. The document discusses the steps to create a web crawler: observe the website's framework, parse the desired parts of the HTML code, and save the extracted data to a JSON file. 2. It recommends using the Beautiful Soup library in Python to parse HTML and extract data, and demonstrates how to select specific parts of a sample web page's code to print. 3. JSON is suggested as the format to save the extracted data because it is a lightweight data interchange format.

1. NCKU TechOrange /Tien Yang/吳典陽
web crawler PTTcrawler
for example

2. PTTcrawler
❖ git clone https://github.com/wy36101299/
PTTcrawler.git!
❖ 比對抓下來的資料和網路上的資料

3. amazing!
how to do it?

4. crawler sop
1st: observe the web’s framework
2nd: parse the part you want
3rd: save to json

5. crawler sop
1st: observe the web’s framework
2nd: parse the part you want
3rd: save to json
final: tell your mom that I got it

6. 1st: observe the web’s framework
html
header
body
footer
div
p

7. 1st: observe the web’s framework
html
header
body
footer
div
p

8. 2nd: parse the part you want
Beautiful Soup is a Python library for pulling data !
out of HTML and XML files.

9. 2nd: parse the part you want
Beautiful Soup is a Python library for pulling data !
out of HTML and XML files.
from bs4 import BeautifulSoup

10. 2nd: parse the part you want
http://hpdswy.ee.ncku.edu.tw/~wy/ncku_orange/crawler_test.html

11. 2nd: parse the part you want
http://hpdswy.ee.ncku.edu.tw/~wy/ncku_orange/crawler_test.html
what’s the top you print?

12. 2nd: parse the part you want
try to parse other part
print which you interested in

13. 3rd: save to json
why we choose json!?

14. 3rd: save to json
JSON (JavaScript Object Notation) is a
lightweight data-interchange format.

15. 3rd: save to json
import json
JSON (JavaScript Object Notation) is a
lightweight data-interchange format.

16. final: tell your mom that I got it
you have become a data scientist !