This document discusses open data and provides an overview of key concepts. It begins with defining open data as data that can be freely used, modified, and shared by anyone for any purpose. Next, it explores why data is opened, including for transparency, participation, and innovation. The document then outlines how to open data using the 5 star deployment scheme. It also evaluates the current state of open data globally using the Global Open Data Index. Finally, the document discusses potential business models and applications that can emerge from open data, including information services, data mining, and more.

1. Open Data
Challenges and Opportunities
Dr. Jieh‐Shan George YEH
jsyeh@pu.edu.tw
2016/12/23

2. Dr. Jieh‐Shan George YEH
Associate Professor
Department of Computer Science
and Information Management
Providence University
Mathematics Ph.D.
The Ohio State University, USA
Specialized Fields
Data Mining, Data Analysis,
Sentimental Analysis, Cloud
Computing
2

3. Outlines
• Prelude
• 2W2H
– What is open data?
– Why “open” data?
– How to “open” data?
– “How open” is now?
• Business Model & Applications
• Conclusion
– What can we participate?
3

4. PRELUDE
From “In God We Trust” to “In Data We Trust”
4

5. AQI – Air Quality Index
5

6. Air Box
https://airbox.edimaxcloud.com/
6

7. Where do we see the phrase
“In God We Trust” usually?
7

8. William Edwards Deming (Oct. 14, 1900 – Dec. 20, 1993) American engineer, statistician,
professor, author, lecturer, and management consultant.
8

9. John Naisbitt (Jan. 15, 1929 ~) American author and public speaker in
the area of futures studies.
9

10. DIKW PYRAMID
A.K.A. information hierarchy or knowledge pyramid
10

11. DIKW Pyramid (DIKW金字塔) DIKW Pyramid Explained
https://www.youtube.com/watch?v=6VmxaaVwmdI
11

12. Data is at the root of all science and engineering developments.
Data alone is interesting but when it is analyzed, it becomes a
powerful tool
A knowledge‐based society is a key driver for socio‐economic
growth, but the knowledge will have to be more accessible,
more relevant and localized
DIKW MODEL
12

13. http://www.multivu.com/assets/58095/documents/Data‐is‐the‐new‐oil‐Infographic‐
original.pdf
資料是新石油
13

14. Data is the New Oil (1/4)
• Clive Humby, UK Mathemetician and
architect of Tesco’s Clubcard, 2006: “Data
is the new oil. It’s valuable, but if unrefined
it cannot really be used. It has to be
changed into gas, plastic, chemicals, etc to
create a valuable entity that drives
profitable activity; so must data be broken
down, analyzed for it to have value.”
14

15. WHAT IS OPEN DATA?
15

16. Open means ...
• “Open means anyone can freely access, use,
modify, and share for any purpose (subject,
at most, to requirements that preserve
provenance and openness).”
• “Open data and content can be freely used,
modified, and shared by anyone for any
purpose”
http://opendefinition.org/od/2.1/en/
16

17. Where Is Open Data From?
• Open data is primarily from
– Science, research
– Government, Public Sector
• Some data is NOT open data
– patents, things with copyright , Health
information , medical records , data required
for authorization
17

18. Types of Data?
18

19. WHY “OPEN” DATA?
19

20. By Law
• In Taiwan: 政府資訊公開法, 2005/12/28
•The Freedom of Government Information Law
第 7 條 下列政府資訊，除依第十八條規定限制公開或不予提供者外，應主動公開 ：
一、條約、對外關係文書、法律、緊急命令、中央法規標準法所定之命令、法規命
令及地方自治法規。
二、政府機關為協助下級機關或屬官統一解釋法令、認定事實、及行使裁量權，而
訂頒之解釋性規定及裁量基準。
三、政府機關之組織、職掌、地址、電話、傳真、網址及電子郵件信箱帳號。
四、行政指導有關文書。
五、施政計畫、業務統計及研究報告。
六、預算及決算書。
七、請願之處理結果及訴願之決定。
八、書面之公共工程及採購契約。
九、支付或接受之補助。
十、合議制機關之會議紀錄。
前項第五款所稱研究報告，指由政府機關編列預算委託專家、學者進行之報告或派赴國外從事考察、進
修、研究或實習人員所提出之報告。第一項第十款所稱合議制機關之會議紀錄，指由依法獨立行使職權
之成員組成之決策性機關，其所審議議案之案由、議程、決議內容及出席會議成員名單。
20

21. By law
• In USA
– 1966, Freedom of Information Act (FOIA)
passed
– 2006, Federal Funding Accountability and
Transparency Act (FFATA) enacted
– 2014, Digital Accountability and Transparency
Act (DATA Act) enacted
http://www.datafoundation.org/state‐of‐the‐union‐of‐open‐data‐2016/
21

22. And because...
• Usually, It belongs to everybody
• Usually, it’s been paid with public money
• It generates economic value
• It creates better citizens
• It promotes transparency (governments,
science, corporations, …)
22

23. Benefit of open government
data
• Transparency and democratic control
• Participation
• Self‐empowerment
• Improved or new private products and services
• Innovation
• Improved efficiency of government services
• Improved effectiveness of government services
• Impact measurement of policies
• New knowledge from combined data sources
and patterns in large data volumes
23

24. CONCERNS & CHALLENGES
24

25. Open Data Concerns
https://www.youtube.com/watch?v=70Zl9jXdzLo 25

26. Challenges...
• Releasing Data
• Fund or support competitions
• Contributing knowledge and skills: by
offering tools, technical support and
advice
• Forming a taskforce to tackle local/global
problems
26

27. HOW TO “OPEN” DATA?
27

28. Every user wants information like
this
28

29. Most of the time, the information
we have is like this
29

30. 5 Star Schema for Open Data
• Tim Berners‐Lee, the inventor of the Web
and Linked Data initiator, suggested a 5‐
star deployment scheme for Open Data.
http://5stardata.info
30

31. Example …
★
make your stuff available on the Web
(whatever format) under an open license
★★
make it available as structured data (e.g.,
Excel instead of image scan of a table)
★★★
make it available in a non‐proprietary
open format (e.g., CSV as well as of Excel)
★★★★
use URIs to denote things, so that people
can point at your stuff
★★★★★
link your data to other data to provide
context
31

32. “HOW OPEN” IS NOW?
32

33. Global Open Data Index
http://index.okfn.org
• An annual effort to measure the state of
open government data around the world.
• Open data measurement is still new and
experimental field.
33

34. GODI ‐ Methodology
• A research question
• Like any other benchmarking tool, the
GODI tries to answer the question:
– “What is the state open data around the
world?”
– “Which country ranks best on open data? Who is the
least/most open country?”
– “ What is the most open dataset? What is the least
open dataset?”
• The first Open Data Index was released on
October 28, 2013. 34

35. Datasets
the full list of datasets for 2015
National Statistics (國家統計) Company Register (公司註冊)
Government Budget (政府預算) Location datasets (位置資料集)
Government Spending (政府支出)
Government procurement
tenders (past and present)
(政府採購招標)
Legislation (立法) Water Quality (水質)
Election Results (選舉結果) Weather forecast (天氣預報)
National Map (國家地圖) Land Ownership (土地所有權)
Pollutant Emissions (污染物排放)
http://index.okfn.org/methodology
35

36. Place overview
36

37. GOVERNMENT DATA SITES
37

38. World
• United Nations, http://data.un.org
• World Bank, http://data.worldbank.org
• European Data Portal,
http://ww.europeandataportal.eu
• U.S. Government’s open data, http://Data.gov
• U.K. Government’s open data, http://Data.gov.uk
38

39. data.un.org
39

40. www.europeandataportal.eu
40

41. Data.gov
41

42. Taiwan
• 台灣政府資料開放平臺
– http://data.gov.tw/
• Data.Taipei臺北市政府資料開放平台
– http://data.taipei/
• Open Data臺中市政府資料開放平台
– http://data.taichung.gov.tw/
• 高雄市政府資料開放平台
– http://data.kaohsiung.gov.tw/Opendata/
• 經濟部工業局 資料服務產業應用推動計畫
– http://opendata.tca.org.tw/
42

43. data.gov.tw
43

44. data.taipei
44

45. SCIENTIFIC DATA
45

46. Science & Research
• Dbpedia, http://wiki.dbpedia.org
• Open Science Data Cloud,
https://www.opensciencedatacloud.org/
• UCI Machine Learning Repository: Data
Sets, https://archive.ics.uci.edu/ml/datasets.html
• The OpenScience Project ‐ Open source
scientific software, http://www.openscience.org/
46

47. Open data map
https://upload.wikimedia.org/wikipedia/commons/3/39/Lod.png
47

48. OPEN DATA BUSINESS MODEL
48

49. “Open Data is going to help launch more startups. It’s
going to help launch more businesses … It’s going to help
more entrepreneurs come up with products and services
that we haven’t even imagined yet.”
US President Barack Obama, May 9, 2013
49

50. Charging?
Free is the default!
• Taxpayer has already paid for most data
• Economic gain maximised when priced at
marginal cost of distribution
– Raw data free
– Possible small service charge for reliable API
• Sales revenue not material to most agencies
• Sales administration typically >25% of revenue
Exception: where data collected for sale
‧“Public task" data free," value added" charged
50Andrew Stott. Experience, Business Models and Case Study of Open Data in UK, Jan 2012

51. 51
Clear, common, licensing
approach
• “Open” licence essential for unrestricted re‐use
• Clarity vital, especially for businesses
• Common licensing for all Government data
valuable
• UK OGL
– free to reuse
– with attribution
– without
misrepresentation
• CC‐BY a good
alternative
51

52. OPEN DATA ECOSYSTEM
52

53. Properties of Open data
53
Data Easy to Use & Re‐use
Re‐purpose, Re‐distribution
Data Easy to Find & Search
Data free to use for anyoneOpen
Accessible
Available
Searchable
Discoverable
Source: Open Data at World Bank, 2011
• machine-readable(機器可判讀)
• complete(完整)
• raw/disaggregate(原始)
• open file format(公開檔案格式)

54. Alison Gill, Hudson Hollister, and Adam Hughes, THE STATE OF THE
UNION OF OPEN DATA, 2016 54

55. JOEL GURIN, DRIVING INNOVATION WITH OPEN DATA
55

56. Open Data Value Chain
https://www.europeandataportal.eu/sites/default/files/edp_creating_value_through_open_data_0.pdf
56

57. 57

58. Emerging Business Models
Models already seen in UK:
 Cleansing and Organizing Data
 Information Services to the Public
 Data Mining
 Operational Efficiency/Optimization
 Financial Products
 Customer Attraction and Retention
 Data Broking
58
Source: Andrew Stott, Experience, Business Models and Case Study of Open
Data in UK (2012.01.18)

59. 59

60. OPEN DATA APPLICATIONS
60

61. INTERNATIONAL
61

62. City Data
• http://www.city‐data.com/
62

63. Data USA
• https://datausa.io/
63

64. Where are the jobs?
• http://www.where‐are‐the‐jobs.com/app.php
• Data Provided by US Department of Labor
64

65. College Scorecard
• https://collegescorecard.ed.gov/
65

66. Information is beautiful
• http://www.informationisbeautiful.net/
66

67. TAIWAN
67

68. G0V 零時政府
http://g0v.tw/zh‐TW/
• 中央政府總預算視覺化
– budget.g0v.tw
• 立委投票指南
– http://vote.ly.g0v.tw/
68

69. Budget visualization
(預算視覺化產生器)
• http://budget.tonyq.org/
69

70. 用數據看台灣
https://www.taiwanstat.com
70

71. Google Disaster Warning
http://www.google.org/publicalerts
71

72. Air Box (空氣盒子)
https://airbox.edimaxcloud.com/
72

73. TOOLS
73

74. Web Tools
• D3 Data‐Driven Documents
– https://d3js.org/
• JavaScript Charts & Maps
– https://www.amcharts.com/
• Online visualization service
– plotdb.com
• Create your free data map
– https://datamaps.co/
• Predict Through Location
– https://carto.com/
74

75. Applications for DV (data visualization)
or BI (Business Intelligence)
• Tableau
– http://www.tableau.com
• Microsoft Power BI
– https://powerbi.microsoft.com
75

76. Lists
• Top Data Visualization Software Products
– http://www.capterra.com/data‐visualization‐
software
• Open Data Tools
– http://opendata‐tools.org
• The 38 best tools for data visualization
– http://www.creativebloq.com/design‐tools/data‐
visualization‐712402
76

77. CONCLUSION
77

78. Benefits of Open Data
• Performance can be enhanced
• The economy can benefit
• Social welfare can be improved
https://www.europeandataportal.eu/en/using‐data/benefits‐of‐open‐data 78

79. WHAT CAN WE PARTICIPATE?
79

80. 80

81. 81

82. Open Campus Data
http://campusdata.org
82

83. 83

84. Sustainable Development Goals
and Open Data
• The United Nations (UN) has developed a set
of action‐oriented goals to achieve global
sustainable development by 2030.
• The 17 Sustainable Development Goals
(SDGs) were developed by an Open Working
Group of 30 member states over a two‐year
process.
• To balance the three dimensions of
sustainable development: the economic,
social and environmental.
http://blogs.worldbank.org/ic4d/sustainable‐development‐goals‐and‐open‐data
84

85. https://sustainabledevelopment.un.org/sdgs
85

86. 86