Download as PDF, PPTX
Uploaded bySammy Fung
Use open source software to develop ideas at work
The document discusses the importance of open source software in future market leadership, emphasizing the freedoms it provides to users and the community. It highlights the evolution of open source technologies, major contributions like Linux and Apache, and examples of open source projects such as a job board and weather data parser. The content also outlines opportunities for community involvement in open source through various organizations and events in Hong Kong.
More Related Content
Similar to Use open source software to develop ideas at work
Use open source software to develop ideas at work
- 1. Use open source software to develop ideas at work Sammy Fung BarCamp Macau 2014
- 2. Sammy Fung ●Python Developer – Perl → PHP → Python ● President at OpenSource.HK ● Community Volunteer in HK & Asia – GNOME.Asia, Mozilla......
- 3. 將來市場領導者必會是 使用及貢獻開放源碼的 企業 Future market leader must be the one which use and contribute open source.
- 4.
- 5. “ Free softwaremeans software that respects users' freedom and community. ” http://www.gnu.org/philosophy/free-sw.html
- 6. 4 Essential Freedoms ● Freedom 0: Run the program. ● Freedom 1: Open Source to study and change it. ● Freedom 2: Re-distribute the program. ● Freedom 3: Distribute your modified versions as free software.
- 7. Ecosystem in Technology Innovation
- 8. Ecosystem in TechnologyInnovation ● Operating Systems ● Servers with Applications ● Clients
- 9. Operating System ●Linux – Server, Desktop, Embedded System. – Mobile (Android). ● 1983: GNU projects developed many free software programs replacing proprietary programs on UNIX platforms. ● 1991: Linus Torvalds released first Linux kernel on internet, then developers integrate with GNU softwares (GNU/Linux) and distribute a new OS. ● Documentary Movie: Revolution OS (2001).
- 10. Web Server ●Apache Software Foundation. ● Apache HTTP Server (Web Server). ● Most popular HTTP server since April 1996. ● 1995: First release ● 2009: 1st web server serving 100 million websites. ● August 2014: 47.92% market share (1st) – http://news.netcraft.com/archives/2014/08/27/august-2014- web-server-survey.html ● Documentary Movie: Revolution OS (2001).
- 11. Applications ● DevelopingWeb Applications and Mobile Applications running on OS platforms. ● Huge amount of free software (open source software) are esstential and used to develop, manage and operate web & mobile apps and their platforms. ● Programming Languages: – PHP, Python, Ruby...... ● Web Frameworks, CMS, Blog......: – Wordpress, Drupal, Django, Joomla......
- 12. Web Browser ●Mozilla Foundation (Found in 2003). ● Firefox Web Browser. ● Market Share: 15-20% (2014), 25-30% (2011). ● 1998: Netscape Communications Corp (creator of Netscape Navigator web browser) created Mozilla project to coordinate open source version of internet suite. – Internet Suite: Web + Mail / Newsgroup + Web Composer + IRC. ● 2002: 1st release Firefox web browser (experimental branch of Mozilla project). ● Sept 2014: Firefox 32. ● Documentary Movie: Code Rush
- 13. Example 1 OpenSource Job Board
- 14. 很多年前 Many yearsago...
- 15. 找工作 Looking fora job
- 16. 一個香港徵才網站 At apopular job site
- 17.
- 18.
- 19. 你會猜到的! You shouldget it!
- 21.
- 22. 市場佔有率 …...in MarketShare
- 23.
- 24.
- 25.
- 26.
- 27. 市場佔有率 …...in MarketShare
- 28.
- 29.
- 30. 做開放源碼的 徵才網站軟件! Developopen source job board software
- 31. 從 Drupal 6模組開始 Development starting from Drupal 6 module
- 32.
- 33. 在今年 In thisyear
- 34. 轉移到 Drupal 7模組 Porting from Drupal 6 to Drupal 7
- 35. API 改變 APIChanged
- 36. 修改了不少 codes Changedsome codes
- 37. GitHub: sammyfung /drupal7-job
- 38.
- 39.
- 40.
- 41. 每個分類也有 獨立RSS RSSFeeds to each job category.
- 42.
- 43. 你就可以有擁有你 自己的徵才網站 Youcan own your job board now
- 44.
- 45. 安裝Linux 網頁伺服器 Installa Linux web server.
- 46. 安裝Drupal 內容管理系統 InstallDrupal Content Management System
- 47. 安裝這徵才網站 的Drupal模組 Installand enable this job board module for Drupal
- 48.
- 49.
- 50. 如果你有任何職位需要懂 任何一種開源軟件技術... Ifyou got any job positions which requires any one of open source software skill sets....
- 51. 就貼去 Post itto job.opensource.hk
- 52. 免費! It's Freeof Charge!
- 53.
- 54. 推出Django 模組 Releasea Django module
- 55. 推出Wordpres 模組? ReleaseWordpress module ?
- 56. 推出Javascript 模組? ReleaseJavascript module ?
- 57.
- 58. Example 2 OpenSource Weather Data Parser
- 59.
- 60. WeatherHK ● Reports – Hourly Current Weather Information – Weather Forecast ● Warning – Tropical Signal issuing, updates, pre-warning.
- 61. WeatherHK ● Interviewby MetroPop in 2009.
- 62.
- 63. TCTrack ● Plotpaths of any active Tropical Cyclones – On Google Map ● Probably the 1st Tropical Cyclones map in Hong Kong using Google Map API. – sammy.hk → Weather Undergroud Hong Kong → HKO – Current Paths. – Forecast Paths. – Tweets JTWC updates to Twitter. – Data Sources: ● JTWC ● HKO
- 64.
- 66. Five Star OpenData 1.make your stuff available on the Web (whatever format) under an open license. 2.make it available as structured data (e.g., Excel instead of image scan of a table) 3.use non-proprietary formats (e.g., CSV instead of Excel) 4.use URIs to denote things, so that people can point at your stuff. 5.link your data to other data to provide context. 5stardata.info by Tim Berners-Lee, the inventor of the Web.
- 67. Web Scraping acomputer software technique of extracting information from websites. (Wikipedia)
- 68. Web Scraping withScrapy
- 69. Scrapy ● Pythonweb scraping framework. ● Scrap websites and extract structured data. ● From data mining to monitoring and automated testing.
- 70. Scrapy Features ●Define your own data structures. ● Write spiders to extract data. ● Built-in XPath selectors to extracting data. ● Built-in JSON, CSV, XML output. ● Interactive shell console, telnet console, logging...... ● Scrapyd – a daemon providing Web API and simple Web UI. – http://localhost:6800
- 71. Scrapy Installation $apt-get install python python-virtualenv python-pip $ virtualenv env $ source env/bin/activate $ pip install scrapy
- 72. Creating a ScrapyProject ● Creating a new scrapy project. – $ scrapy startproject <project name> ● Define your data structure ● Write your first spider – Test with scrapy shell console ● Output / Store collected data – Output with built-in supported formats – Store to database / object store.
- 73. Scrapy + Django ● Django – Python web framework ● Installing Django via pip – $ pip install django ● Scrap with Scrapy and store data with Django
- 74. Creating django project ● Creating a Django project. – $ django-admin.py startproject <project name> ● Define django settings. – <project name>/settings.py – Create database, tables and first django user. ● $ python manage.py syncdb – Define installed django apps with INSTALLED_APPS array.
- 75. Creating a DjangoApp ● Create your own django app. – $ python manage.py startapp <new app name> ● Define data model at models.py – $ python manage.py syncdb ● Activate django admin UI at admin.py – Add URL router to access admin UI.
- 76. Define django datamodel class WeatherData(models.Model): reporttime = models.DateTimeField() station = models.CharField(max_length=3) temperture = models.FloatField(null=True, blank=True) humidity = models.IntegerField(null=True, blank=True)
- 77. Enable django adminui ● Adding to INSTALLED_APPS at settings.py – django.contrib.admin ● Adding URL router at urls.py – $ python manage.py runserver ● Access admin UI – http://127.0.0.1:8000/admin
- 78. Scrapy + Django ● Define django environment at scrapy settings. – Load django configuration. ● Use Scrapy DjangoItem class – Insteads of Item and Field class – Define which django data model should be linked with. ● Query and insert data at scrapy pipelines.
- 79.
- 80. hk0weather ● WeatherData Project. – https://github.com/sammyfung/hk0weather – convert weather information to JSON data from HKO webpages. – python + scrapy + django
- 81. hk0weather ● HongKong Weather Data. – 20+ HKO weather stations in Hong Kong. – Regional weather data. – Rainfall data. – Weather forecast report.
- 82. Hk0weather installation ●Setup and activate a python virtual enviornment, and install scrapy and django with pip. ● Clone hk0weather from GitHub – $ git clone https://github.com/sammyfung/hk0weather.git ● Setup database connection at Django and create database, tables and first django user. ● Scrap regional weather data – $ scrapy crawl regionalwx -t json -o regional.json
- 84. How can you use & participate open source software ?
- 85.
- 87. Hong Kong LinuxUser Group ● http://www.linux.org.hk/ ● Re-established in 1997. ● Linux Talks, Seminiars and Workshops. ● Linux Cafe meetups. ● Linux Exhibitions and Demostrations.
- 89. Open Source HongKong ● http://www.opensource.hk ● Established in 2008. ● Events: Workshops, Hackathons, Conferences.
- 90. Monthly Events - Open Source Workshops
- 91.
- 92. Hong Kong OpenSource Conferences
- 93. Hong Kong CreativeOpen Technology Association ● http://www.cota.hk ● Established in 2014. ● HK registered limited company in guarantee. ● Non-profit organization. (in final process) ● Promoting Open Standards, Free and Open Source Software, Open Hardware, Free Culture Works, Open Content and Creative Commons. ● Work on projects and events. – eg. Hong Kong Open Source Conference 2014.
- 94.
- 95. “ Free softwaremeans software that respects users' freedom and community. ” http://www.gnu.org/philosophy/free-sw.html
- 96. 將來市場領導者必會是 使用及貢獻開放源碼的 企業 Future market leader must be the one which use and contribute open source.
- 97. Welcome to inviteme to...... ● Meetings, Talks, Workshops and Events – at your company and schools. ● Projects – Development – Consultation ● Let's get a name card.
- 98.