Lessons from Canada’s First Open Data Exchange
CANARIE NATIONAL SUMMIT 2016
“WITHOUT DATA YOU’RE
JUST ANOTHER PERSON
WITH AN OPINION.”
- W. EDWARDS DEMING
DATA SCIENTIST
Data is disruptive, powerful and dangerous
Data is the “new oil” and the “asbestos.”
Unlike oil, we are not going to run out of
it. We are amassing more and more and
unlike asbestos, the problems it’ll
introduce, are also endless.
–Tom Jenkins
Google KW
DATA CHANGES EVERYTHING
THE
NEW OIL
Can’t apply linear solutions
Electromagnetic radiation lab UW
90% OF THE
WORLDS DATA
LIVING IN AN EXPONENTIAL WORLD
CREATED IN THE
LAST 2 YRS
codx.caCanada’s Open Data Exchange 5
Before Its News
DATA EXHAUST
* McKinsey, 2015
 30,000 sensors
 Less than 1% of data being
used
 Better data analytics could
result in:
 Boosted production by 6-
8%
 Improved uptime upwards
of 10%
codx.caCanada’s Open Data Exchange 6
WIRED
TRUMP’S
WIN ISN’T
THE DEATH
OF DATA –
IT WAS
FLAWED
ALL ALONG
Flawed data?
Flawed analytics?
Programmed
biases?
Data poverty?
codx.caCanada’s Open Data Exchange
Wisdom
Knowledge
Information
Data
Value
codx.caCanada’s Open Data Exchange
Commercialization Gap
CONNECTING
DATA WITH
OPPORTUNITY
OPPORTUNITY
Analytics
Visualization
Business Intelligence
AI & Machine Learning
Map/Reduce
Cloud Storage
Data Governance
DATA
Product Creation
Process Improvement
Cost Reduction
Customer Information
Open Data
Transactions
Pricing Information
Data from External APIs
Behavioural Data
Healthcare
codx.caCanada’s Open Data Exchange
UNPACKING THE OPPORTUNITY
codx.caCanada’s Open Data Exchange
 “A piece of data is open if anyone is free
to use, reuse, and redistribute it —
subject only, at most, to the requirement
to attribute and/or share-alike.”
 A key element of Open Government
 Open Data is often associated with
government data but doesn't have to be
What is Open Data?
codx.caCanada’s Open Data Exchange
HOW OPEN IS THE DATA?
codx.caCanada’s Open Data Exchange
OPEN DATA IN CANADA
Open Data Canada 2015
codx.caCanada’s Open Data Exchange
WHO HAS WHAT OPEN DATA?
Level of Gov’t Responsibilities Types of Data
Federal Agriculture, Financial Services,
Economic Data, Natural
Resources, CRA, Census, Weather
Criminal Code
Weather
GIS and Imagery
Economic Data
Tax Code
Provincial Courts, Education, Environment,
Energy, Health Care
K-12 Curriculum
Court Rulings
Municipal Water, Traffic, Parking, Property
Tax
Property Tax
Traffic Flows
codx.caCanada’s Open Data Exchange
codx.caCanada’s Open Data Exchange 16
codx.caCanada’s Open Data Exchange
McKinsey report released in October 2013, Open data: Unlocking innovation and performance with liquid information
40+
Countries with government
open data platforms
1million+
Data sets made open by
governments worldwide
102
Cities that participated in 2013
International Open Data
Hackathon Day
The GLOBAL Opportunity for Open Data
$3,000,000,000,000
in economic value
codx.caCanada’s Open Data Exchange
What $3,000,000,000,000 in economic value means
+50%
Consumer share of
potential value of open data
35
Hours per year, per commuter, could
be saved from schedule changes based
on open data
3 billion
Metric tons of carbon dioxide equivalent
emission reductions from buildings that
could be identified through the use of
open data
100,000+
Medical, health, and fitness apps
for smartphones
codx.caCanada’s Open Data Exchange
codx.caCanada’s Open Data Exchange
codx.caCanada’s Open Data Exchange
PiinPoint sources data sets from
municipality open data websites
across North America, providing
retailers with continuous
municipal open data.
Open data at PiinPoint
• Traffic counts
• Pedestrian counts
• Building permits
• Development plans
• Parking spots
• Public transportation
• Zoning
• Census
• …and more
codx.caCanada’s Open Data Exchange
ThinkData Works sources open
data from governments around
the world and makes it available
on a consistent API within the
firewall.
Features and data sets
• Search (Namara.io)
• Boundaries &Regions
• Economy
• Education
• Energy
• Environment
• Parking
• Transport
• Trade
• Housing
Used by asset managers and in programmatic trading.
codx.caCanada’s Open Data Exchange
Privacy
Prioritization
Resources
Used by asset managers and in programmatic trading.
Discovery & Access
Standards
Quality
Barriers to
mainstream adoption
codx.caCanada’s Open Data Exchange
A private-public
partnership The founding partners have committed to
$3 million in cash and in-kind contributions over
three years, which has been matched by the
Government of Canada.
codx.caCanada’s Open Data Exchange
Building the open data supply chain
RawData
Public data
• Government
Organization has
a challenge or
opportunity?
Collection &
transmission
• Security
• Storage
• Networks
Analytics,
discovery
& management
• Data Mining
• Data Fusion & Interoperability
• Data Manipulation
• Visualization
Applications
• Business case development
• Systems Integration
• uX/uD
• Commercialization expertise
Your organization
StructuredData
Knowledge
EndUser
codx.caCanada’s Open Data Exchange
What have we learned?
• Analysts are more and
more in demand
• Companies cant be
expected to capitalize
on open data unless
they have the
capabilities to properly
analyze and mine their
own data for
knowledge
• Data is a disrupter
• Many companies
don’t identify as being
open data enabled
companies even
though they might be
using open data of
some sort
• Data is the new
currency
• Large enterprises are
starting to realize the
intrinsic value of their
own data and are
looking to develop
strategies to open up
their data to a wider
developer community
to fuel innovation
• Enterprise, SME and
start ups alike are
getting more engaged
in open data
• Many companies aren’t
sure where to start with
open data OR it’s not top of
mind
?
codx.caCanada’s Open Data Exchange
Skills Development
• Workshops
• Peer2Peer Groups
Services and Tools
• Mentorship
• Concierge
Awareness
• OD150 Project
• Open Cities Index
• Events
Ecosystem
Development
• Online Community
• Project Funding
• ODX Connect
Soft Landing Program
• ODX Ventures
• ODX Challenge Series
PROGRAMS AND SERVICES
codx.caCanada’s Open Data Exchange
The Open Data 150
The OD150 Survey will create the first
comprehensive, internationally comparable
inventory of Canadian companies that use open
data to:
• Launch new products and services,
• Optimize their business processes,
• Make data-driven decisions,
• And solve complex problems.
Why undertake this initiative?
• Raise awareness of open data use in Canada
• More effective advocacy efforts
• Understand what support companies need most
urgently
• Encourage more open data sets
• Identify best practices of how companies can use open
data to enhance their products/servicesFor more information: www.opendata500.com/ca/
codx.caCanada’s Open Data Exchange
codx.caCanada’s Open Data Exchange
codx.caCanada’s Open Data Exchange
ODX Open Data Challenge
Problem
Areas
Data
Staff Time
Companies
Tools
Expertise
Applicants Finalists
Sponsoring
Municipality
Objectives:
• Tackle complex municipal problems with new, innovative solutions
• Create applications, products and services that create jobs and wealth
• Demonstrate that open data can catalyze private sector to solve problems in public sector
?
Problem
Identification
Solution
codx.caCanada’s Open Data Exchange
Challenges:
Challenge 1: Water Usage Data- How can Guelph Water Services enable
citizens to detect leaks and reduce their water use?
Challenge 2: Parking – How can we maximize the value of parking space
in the downtown?
Challenge 3: Statutory Notices- How can we make it easier for the public
to provide feedback on planning decisions?
codx.caCanada’s Open Data Exchange
• City/Municipality must be prepared to:
– Have a champion to lead from within
– Build internal trust/relationships with departments and subject matter experts
– Clearly define the problem to be solved
– Modify their procurement process to allow start-ups and SME’s to participate
– Work with challenge finalists to improve their solutions
– Be prepared to implement solutions should they meet the criteria
– Bring open data to the table to enable problem definition and solution
evaluation
Critical elements
codx.caCanada’s Open Data Exchange
Business Ready Badge
Canada’s Open Data Exchange
wants to recognize businesses
and governments who are
maximizing the economic value
from Open Data by providing
them with this badge that they
can proudly display.
Contact info@codx.ca to request
your badge.
codx.caCanada’s Open Data Exchange
• LinkedIn: Canada’s Open Data Exchange
• Web: codx.ca
• Twitter: @codx
• Newsletter: for updates on open data news, events and programs within
Canada
Follow our progress
Thank You!
Kevin Tuer
@ktuer, kevin@codx.ca

Lessons from Canada’s First Open Data Exchange

  • 1.
    Lessons from Canada’sFirst Open Data Exchange CANARIE NATIONAL SUMMIT 2016
  • 2.
    “WITHOUT DATA YOU’RE JUSTANOTHER PERSON WITH AN OPINION.” - W. EDWARDS DEMING DATA SCIENTIST
  • 3.
    Data is disruptive,powerful and dangerous Data is the “new oil” and the “asbestos.” Unlike oil, we are not going to run out of it. We are amassing more and more and unlike asbestos, the problems it’ll introduce, are also endless. –Tom Jenkins Google KW DATA CHANGES EVERYTHING THE NEW OIL
  • 4.
    Can’t apply linearsolutions Electromagnetic radiation lab UW 90% OF THE WORLDS DATA LIVING IN AN EXPONENTIAL WORLD CREATED IN THE LAST 2 YRS
  • 5.
    codx.caCanada’s Open DataExchange 5 Before Its News DATA EXHAUST * McKinsey, 2015  30,000 sensors  Less than 1% of data being used  Better data analytics could result in:  Boosted production by 6- 8%  Improved uptime upwards of 10%
  • 6.
    codx.caCanada’s Open DataExchange 6 WIRED TRUMP’S WIN ISN’T THE DEATH OF DATA – IT WAS FLAWED ALL ALONG Flawed data? Flawed analytics? Programmed biases? Data poverty?
  • 7.
    codx.caCanada’s Open DataExchange Wisdom Knowledge Information Data Value
  • 8.
    codx.caCanada’s Open DataExchange Commercialization Gap
  • 9.
    CONNECTING DATA WITH OPPORTUNITY OPPORTUNITY Analytics Visualization Business Intelligence AI& Machine Learning Map/Reduce Cloud Storage Data Governance DATA Product Creation Process Improvement Cost Reduction Customer Information Open Data Transactions Pricing Information Data from External APIs Behavioural Data Healthcare
  • 10.
    codx.caCanada’s Open DataExchange UNPACKING THE OPPORTUNITY
  • 11.
    codx.caCanada’s Open DataExchange  “A piece of data is open if anyone is free to use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike.”  A key element of Open Government  Open Data is often associated with government data but doesn't have to be What is Open Data?
  • 12.
    codx.caCanada’s Open DataExchange HOW OPEN IS THE DATA?
  • 13.
    codx.caCanada’s Open DataExchange OPEN DATA IN CANADA Open Data Canada 2015
  • 14.
    codx.caCanada’s Open DataExchange WHO HAS WHAT OPEN DATA? Level of Gov’t Responsibilities Types of Data Federal Agriculture, Financial Services, Economic Data, Natural Resources, CRA, Census, Weather Criminal Code Weather GIS and Imagery Economic Data Tax Code Provincial Courts, Education, Environment, Energy, Health Care K-12 Curriculum Court Rulings Municipal Water, Traffic, Parking, Property Tax Property Tax Traffic Flows
  • 15.
  • 16.
  • 17.
    codx.caCanada’s Open DataExchange McKinsey report released in October 2013, Open data: Unlocking innovation and performance with liquid information 40+ Countries with government open data platforms 1million+ Data sets made open by governments worldwide 102 Cities that participated in 2013 International Open Data Hackathon Day The GLOBAL Opportunity for Open Data $3,000,000,000,000 in economic value
  • 18.
    codx.caCanada’s Open DataExchange What $3,000,000,000,000 in economic value means +50% Consumer share of potential value of open data 35 Hours per year, per commuter, could be saved from schedule changes based on open data 3 billion Metric tons of carbon dioxide equivalent emission reductions from buildings that could be identified through the use of open data 100,000+ Medical, health, and fitness apps for smartphones
  • 19.
  • 20.
  • 21.
    codx.caCanada’s Open DataExchange PiinPoint sources data sets from municipality open data websites across North America, providing retailers with continuous municipal open data. Open data at PiinPoint • Traffic counts • Pedestrian counts • Building permits • Development plans • Parking spots • Public transportation • Zoning • Census • …and more
  • 22.
    codx.caCanada’s Open DataExchange ThinkData Works sources open data from governments around the world and makes it available on a consistent API within the firewall. Features and data sets • Search (Namara.io) • Boundaries &Regions • Economy • Education • Energy • Environment • Parking • Transport • Trade • Housing Used by asset managers and in programmatic trading.
  • 23.
    codx.caCanada’s Open DataExchange Privacy Prioritization Resources Used by asset managers and in programmatic trading. Discovery & Access Standards Quality Barriers to mainstream adoption
  • 24.
    codx.caCanada’s Open DataExchange A private-public partnership The founding partners have committed to $3 million in cash and in-kind contributions over three years, which has been matched by the Government of Canada.
  • 25.
    codx.caCanada’s Open DataExchange Building the open data supply chain RawData Public data • Government Organization has a challenge or opportunity? Collection & transmission • Security • Storage • Networks Analytics, discovery & management • Data Mining • Data Fusion & Interoperability • Data Manipulation • Visualization Applications • Business case development • Systems Integration • uX/uD • Commercialization expertise Your organization StructuredData Knowledge EndUser
  • 26.
    codx.caCanada’s Open DataExchange What have we learned? • Analysts are more and more in demand • Companies cant be expected to capitalize on open data unless they have the capabilities to properly analyze and mine their own data for knowledge • Data is a disrupter • Many companies don’t identify as being open data enabled companies even though they might be using open data of some sort • Data is the new currency • Large enterprises are starting to realize the intrinsic value of their own data and are looking to develop strategies to open up their data to a wider developer community to fuel innovation • Enterprise, SME and start ups alike are getting more engaged in open data • Many companies aren’t sure where to start with open data OR it’s not top of mind ?
  • 27.
    codx.caCanada’s Open DataExchange Skills Development • Workshops • Peer2Peer Groups Services and Tools • Mentorship • Concierge Awareness • OD150 Project • Open Cities Index • Events Ecosystem Development • Online Community • Project Funding • ODX Connect Soft Landing Program • ODX Ventures • ODX Challenge Series PROGRAMS AND SERVICES
  • 28.
    codx.caCanada’s Open DataExchange The Open Data 150 The OD150 Survey will create the first comprehensive, internationally comparable inventory of Canadian companies that use open data to: • Launch new products and services, • Optimize their business processes, • Make data-driven decisions, • And solve complex problems. Why undertake this initiative? • Raise awareness of open data use in Canada • More effective advocacy efforts • Understand what support companies need most urgently • Encourage more open data sets • Identify best practices of how companies can use open data to enhance their products/servicesFor more information: www.opendata500.com/ca/
  • 29.
  • 30.
  • 31.
    codx.caCanada’s Open DataExchange ODX Open Data Challenge Problem Areas Data Staff Time Companies Tools Expertise Applicants Finalists Sponsoring Municipality Objectives: • Tackle complex municipal problems with new, innovative solutions • Create applications, products and services that create jobs and wealth • Demonstrate that open data can catalyze private sector to solve problems in public sector ? Problem Identification Solution
  • 32.
    codx.caCanada’s Open DataExchange Challenges: Challenge 1: Water Usage Data- How can Guelph Water Services enable citizens to detect leaks and reduce their water use? Challenge 2: Parking – How can we maximize the value of parking space in the downtown? Challenge 3: Statutory Notices- How can we make it easier for the public to provide feedback on planning decisions?
  • 33.
    codx.caCanada’s Open DataExchange • City/Municipality must be prepared to: – Have a champion to lead from within – Build internal trust/relationships with departments and subject matter experts – Clearly define the problem to be solved – Modify their procurement process to allow start-ups and SME’s to participate – Work with challenge finalists to improve their solutions – Be prepared to implement solutions should they meet the criteria – Bring open data to the table to enable problem definition and solution evaluation Critical elements
  • 34.
    codx.caCanada’s Open DataExchange Business Ready Badge Canada’s Open Data Exchange wants to recognize businesses and governments who are maximizing the economic value from Open Data by providing them with this badge that they can proudly display. Contact info@codx.ca to request your badge.
  • 35.
    codx.caCanada’s Open DataExchange • LinkedIn: Canada’s Open Data Exchange • Web: codx.ca • Twitter: @codx • Newsletter: for updates on open data news, events and programs within Canada Follow our progress
  • 36.

Editor's Notes

  • #3 Notion of using data not new. More focus on evidence based decision making is being powered by digital and big data An American engineer, statistician, professor, author, lecturer, and management consultant Many in Japan credit Deming as one of the inspiration for what has become known as the Japanese post-war economic miracle of 1950 to 1960, when Japan rose from the ashes of war to start Japan on the road to becoming the second largest economy in the world through processes partially influence by the ideas Deming taught
  • #4 Be prepared. It will make the industrial revolution look like blip. Liken it to an ice-age or a tsunami of information. it will change everything.
  • #5 Data is the opportunity and, as a resource, it is growing exponentially. This is disruption. Linear solutions don’t apply.
  • #6 A challenge the entire industry is facing, almost putting cart before the horse There has been a focus on creating data, less around what to do with the data As such, we are leaving significant value on the table
  • #7 Recent US election has illustrated our shortcomings in dealing with data Points to a systemic breakdown that we need to address before we can unlock the true value
  • #8 The value flow of data in a perfect world
  • #10 Arguably, not a shortage of data We need to do a better job of processing it Most lucrative part of the value chain
  • #11 Must be all about the data Source agnostic Need to shed the hype and focus on value creation I want to focus on open data in particular.
  • #12 What is open data?
  • #13 How open is the data?
  • #15 Who has the data?
  • #17 Readiness: the readiness of states, citizens and entrepreneurs to secure the benefits of open data Implementation: Are governments putting their commitments into practice? Impact: Is open government data being used in ways that bring practical benefit?
  • #18 The release of open data is trending in the upward direction. Canada is one of many nations that are adopting open data policies. Open data is not a resource that is unique to Canada. This is a global phenomena McKinsey report released in October 2013, Open data: Unlocking innovation and performance with liquid information.
  • #19 It can be used to provide value in a wide variety of ways
  • #20 Companies have already built multi-billion dollar businesses on Open Data, even though we may not know them as such. Intuit – TurboTax, based on open disclosure of tax calculations Weather Network – based on one of the oldest forms of government open data, weather forecasts and reports Garmin – heavy user of open GIS data and GPS location, and Zillow – heavy user of geospatial, tax rolls, and real-estate data
  • #21 A sampling of activity in Canada
  • #22 Retail analytics
  • #24 Historically, open data was made available with transparency and open government in mind
  • #25 The Canadian Open Data Exchange, a public-private partnership, has been created to help the private sector tap into open data sources for commercial benefit Its success will be measured by the success of the private sector partners it serves.
  • #26 Along the way, ODX will enable the creation of supply chains using an ecosystem approach. ODX will identify Canadian capabilities in every part of the supply chain. ODX will create awareness around those that are already using open data and will serve as an advocate to inform the supply chain of the needs of the applications, thereby driving standards and policy.
  • #29 OD150 for Canada’s 150th birthday. Hoping to have action plans based on the findings from OD150 for Canada’s 150th birthday. Canada is the 6th member of the OD500 international network, which also includes Australia, Mexico, Italy, Korea, and the United States. By joining this network, ODX gains knowledge of how companies around the world are using open data. We’ll also get to learn how other countries are improving the business climate for open companies through improved access to data and ongoing advocacy efforts
  • #30 Respondent location: The majority of early respondents are located in Ontario & Quebec, with 3 regions demonstrating an emerging yet mature industrial Open Data capability – Greater Toronto Area, Waterloo Region, and Montreal. Greatest challenge to business success: Respondents were asked to identify their top business challenges. Unsurprisingly, there are a myriad of challenges facing companies using open data in Canada, and respondent companies were consistent in the areas they found most challenging. As Canada begins to understand the needs of businesses using Open Data, these challenges present important guideposts for creating greater opportunity for businesses.
  • #31 Data sources: There is a consistent use of data from all government jurisdictions in Canada – knowing that many of these companies are location specific due to data availability, this demonstrates a significant opportunity for governments to create common data sets and standards to permit companies to scale. It is also interesting that some Canadian companies have been able to integrate US data sets into their business. Revenue source: There is a strong preponderance among respondent companies towards revenue streams based on analyzing and interpreting data for clients. As many respondents identified “difficulty finding/accessing data” as a key challenge, it is reasonable to expect that those who are familiar with open data have parlayed this knowledge into analytical services for companies that do not have this capability. Industries represented: There is a wide distribution of industries represented, a result of the (1) varying availability of data across jurisdictions and (2) levels of granularity. It is expected that one of the leading industries is Geospatial/Mapping, as at the Federal and Provincial levels the most frequently released open data sets are geospatial (NRCan is the leading Federal department with over 110,000 open data sets on Canada’s open data portal).
  • #35 Criteria for businesses: Identify how open data drives economic benefit for your business Identify and advocate for the release of open data sets Share standards and other requirements to simplify and improve the use of Open Data Participate and provide employees with access to Open Data training programs Criteria for Government: Release and update Open Data as part of their mandate; data must be machine-readable and allowed for re-use and re-distribution Provide the means for businesses & individuals to download Open Data Promote programs that use Open Data Regularly Interface with businesses to understand commercial uses of open data and additional needs