• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Collecting web information with open source tools
 

Collecting web information with open source tools

on

  • 1,152 views

my lightening talk slide at coscup 2011, taipei

my lightening talk slide at coscup 2011, taipei

Statistics

Views

Total Views
1,152
Views on SlideShare
1,151
Embed Views
1

Actions

Likes
1
Downloads
14
Comments
0

1 Embed 1

http://feedly.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Collecting web information with open source tools Collecting web information with open source tools Presentation Transcript

    • Collectinguseful information from web withopen source tools
    • @sammyfung
    • Hong Kong
    • First chairman ofHong Kong Linux User Group
    • opensource.hk webmaster
    • How does programmers solve problems in daily life ? 程式員解決現實問題的方法 ?
    • Coding!就是寫程式 !
    • a lot of popular web sites running on II$ in Hong Kong.香港很多大型網站 都是用 II$
    • Very slow when youre using!當你在用的時候,就會很慢!
    • Visiting websites manually,repeatly for any latest update. 為了追蹤最新消息,人手重覆重瀏覽同一網站
    • Will you still addicted to plurk/twitter withoutauto new response/reply alert ?如果沒有自動新回應提 示 , 你還會沉迷噗浪 和推特 ?
    • What do you need ? 你需要甚麼 ?
    • Regular Expression
    • HTML Parser
    • Web Crawling Framework
    • scrapy.org
    • About Scrapy written in python x = HtmlXPathSelector(response) torrent = TorrentItem() torrent[url] = response.urltorrent[name] = x.select("//h1/text()").extract() <h1>Hello World</h1>
    • all of above are available in open source!以上所有的也有 開源軟件
    • Problem #1a lot of popular web sites running on II$ in Hong Kong.
    • develop a list of football matches live on cable tv做了「電視足球直播時間表」
    • Problem #2some web sites doesnt provide data API.
    • Hong Kong Weather Info 香港天氣
    • @weatherhk
    • Alerts of Tropical Cyclonesin Northwest Pacific Ocean @tctrack @tropicalhk
    • Path and Forecast ofactive tropical cyclone
    • Lets solveyour own problems with open source tools. 所以多多利用開源軟件 來解決 你生活上遇到的問題吧   Thank you! 謝謝 !
    • solving problems with open source. Thank you.