2018/7/22 업데이트: requests를 사용하는걸 추천합니다. https://github.com/requests/requests/ Python에서 urllib, urllib2를 간단하게 사용하는 법입니다. 그래서 8페이지 밖에 안됩니다!

1. Python - urllib
2014년 1월 18일 최백준

2. urllib
import urllib
fp =
urllib.urlopen(‘http://www.acmicpc.net
’)
s = fp.read()
fp.close()

3. urllib2
import urllib2
url = ‘http://www.acmicpc.net/’
req = urllib2.Request(url)
fp = urllib2.urlopen(req)
s = fp.read()
fp.close()

4. urllib2
s = ‘’
while True:
data = fp.read(1024)
if not len(data):
break
s += data
fp.close()

5. urllib2 - get
url =
‘http://www.acmicpc.net/status/?proble
m_id=9251'

6. urllib2 - post
data = urllib.urlencode({
‘q’: ‘*’,
‘outmax’: 150,
‘pg’: 2,
})
fp = urllib2.urlopen(req,data)

7. urllib2 - header
user_agent = ‘~~~’
headers = {
‘User-Agent’: user_agent
}
req = urllib2.Request(url,data,headers)

8. cookielib
cookie_jar = cookielib.LWPCookieJar()
cookie =
urllib2.HTTPCookieProcessor(cookie_jar)
opener = urllib2.build_opener(cookie)
req = urllib2.Request(url, data, headers)
fp = opener.open(req)