Open Data - a goldmine1Open Data – a goldminePhoto by BullionVault @ Flickr, CC BY-ND

the speakerSvein-Magnus SørensenMaster of Science in Communications Technology from NTNUGraduate from the Norwegian School of Entrepreneurship (Gründerskolen)Past experience include:Knowledge engineer at Computas AS (Oslo, Norway)Integration engineer at Searchforce Inc. (San Mateo, California)Currently: Business Analyst at Objectware ASWeblog: http://blog.menneske.orgTwitter: http://twitter.com/sveinmagnusSlideshare: http://slideshare.net/sveinmagnus2Open Data - a goldmine

Master of Science in Communications Technology from NTNU

Graduate from the Norwegian School of Entrepreneurship (Gründerskolen)

Weblog: http://blog.menneske.org

Twitter: http://twitter.com/sveinmagnus

Slideshare: http://slideshare.net/sveinmagnus

3Open Data - a goldmineCONTENTMATTERS

Whyisn’t it enough?Open source doesn’t require open formatsOpen source only covers the softwareData often lasts longer than softwareData is more valuable when accessibleAny code will be acceptable, any data won’t4Open Data - a goldmineGraphic by OpenSourceInitiative, CC BY

Open source doesn’t require open formats

Open source only covers the software

Data often lasts longer than software

Data is more valuable when accessible

Any code will be acceptable, any data won’t

Open data – real goldCanadian GoldCorp Inc. was near collapse in the late 90’ies.It’s Red Lake mine showed reduced output after 50 years of production Then something previously unheard of happened: Inspired by the crowd-sourcing of Linux and Open Source, Rob McEwen announced The GoldCorp Challenge: a competition to find new gold in the mine. The full geological dataset from Red Lake was made available to contestants.5Open Data - a goldminePhoto by Rickz @ Flickr, CC BY-NC-ND

6Open Data - a goldmineAnd the result?110 new targets were suggested by contestants from around the world.80% of the targets submitted yielded substantial quantities of new goldGoldCorp got first look a wealth of new technologies for mine analysisProduction at Red Lake increased tenfold while mining costs dropped to 1/6th of their previous levels.Photo by BullionVault @ Flickr, CC BY-ND

110 new targets were suggested by contestants from around the world.

80% of the targets submitted yielded substantial quantities of new gold

GoldCorp got first look a wealth of new technologies for mine analysis

Production at Red Lake increased tenfold while mining costs dropped to 1/6th of their previous levels.

What is Open Data? Open Knowledge Definition(http://www.opendefinition.org/)Open data/content/information must: Be Available and Accessible at Reproduction Cost “As a Whole” Permit Free Redistribution Permit Reuse Under Same Terms Be Absent of Technological Restrictions Be Attributed as Required Keep Source Integrity Not Discriminate Access From Persons or Groups Not Discriminate Against Fields of Endeavor Be Distributed with only the Original License Must Not Be Licensed Specific to a Package Must Not by License Restrict the Distribution of Other Works7Open Data - a goldmineGraphic by ronin691 @ Flickr, CC BY-SA

Whyshouldwecreate open data?Restrictions on data re-use can create an anti-commons and its related tragedy.8Open Data - a goldminePhoto by robokow Flickr, CC BY-NC-SA

Restrictions on data re-use can create an anti-commons and its related tragedy.

Whyshouldwecreate open data?Sponsors may not get full value of research unless the results are made freely available.The rate of discovery often accelerates with better access to data.9Open Data - a goldminePhoto by Victor.Correa Flickr, CC BY-NC-SA

Sponsors may not get full value of research unless the results are made freely available.

The rate of discovery often accelerates with better access to data.

Whyshouldwecreate open data?Data access is often required for the operation of communal human activities.10Open Data - a goldminePhoto by coreytempleton Flickr, CC BY-NC-SA

Data access is often required for the operation of communal human activities.

Whyshouldwecreateopen data?11Open Data - a goldmineThis presentation would have been really boring without the fully and partially open data available from Wikipedia, Flickr and the open data projects online!

12Open Data - a goldmineIfyou love something…Set it free!Photo by keltanen @ Flickr, CC BY-NC

Whenshouldwedemand Open Data?When the data belongs to the human race 13Open Data - a goldminePhoto by guiguibu91 @ Flickr, CC BY

When the data belongs to the human race

Whenshouldwedemand Open Data?When the data consists of independently verifiable facts or common knowledge14Open Data - a goldmine

When the data consists of independently verifiable facts or common knowledge

Whenshouldwedemand Open Data?When public money fundedthe creation of the dataWhen the data was created at a government institutionWhen the source of the data was a public endeavor15Open Data - a goldminePhoto by Steve Wampler @ Flickr, CC BY

When public money fundedthe creation of the data

When the data was created at a government institution

When the source of the data was a public endeavor

Saving lives with open dataM.V. Rocknes was a 166-metre cargo-ship with a crew of 30.January 19th 2004 she ran aground and capsized. 18 people died in the accident.The use of outdated maps by both the crew and the Norwegian pilotage authorities contributed to the wreck.16Open Data - a goldminePhotos by Smit International / Scanpix

M.V. Rocknes was a 166-metre cargo-ship with a crew of 30.

January 19th 2004 she ran aground and capsized. 18 people died in the accident.

The use of outdated maps by both the crew and the Norwegian pilotage authorities contributed to the wreck.

Examples from NorwayNorwegian Medicines AgencyOpen medical databases can aid both research and healthcare.Data on approved medicines in Norway were made available online in 2008.17Open Data - a goldmineNorwegian Mapping AuthorityOpen maps can prevent fatal accidents, especially at sea.The ”Rocknes”-wreck in 2004 might have been avoided with open maps.Updated maps are still not available to Norwegian pilotage authorities.In the United States, official nautical maps are freely available online.Norwegian Pollution Control AuthorityA central database of information on various materials can improve safety.Many databases on hazardous chemicals are outdated and of limited scope.No single source of up to date and complete information are available.

Norwegian Medicines Agency

Open medical databases can aid both research and healthcare.

Data on approved medicines in Norway were made available online in 2008.

Norwegian Mapping Authority

Open maps can prevent fatal accidents, especially at sea.

The ”Rocknes”-wreck in 2004 might have been avoided with open maps.

Updated maps are still not available to Norwegian pilotage authorities.

In the United States, official nautical maps are freely available online.

Norwegian Pollution Control Authority

A central database of information on various materials can improve safety.

Many databases on hazardous chemicals are outdated and of limited scope.

No single source of up to date and complete information are available.

18Open Data - a goldmineGraphic by W3C SWEO Linking Open Data, CC BY-SA

Wikipedia defines Linked Data as “a term used to describe a recommended best practice for exposing, sharing, and connecting pieces of data, information, and knowledge on the Semantic Web using URIs and RDF.”Linked Data is about using the Web to connect related data that wasn't previously linked, or using the Web to lower the barriers to linking data currently linked using other methods. The semantic web currently containsseveral billion triples of linked data.http://linkeddata.org/19Open Data - a goldmineGraphic by semanticwebcompany@ Flickr, CC BY-NC-SA

DBpedia is a community effort to extract structured information from Wikipedia and to make this information available on the Web. DBpedia allows you to ask sophisticated queries against Wikipedia, and to link other data sets on the Web to Wikipedia data. The DBpedia knowledge base currently describes more than 2.6 million things, including at least 213,000 persons, 328,000 places, 57,000 music albums, 36,000 films, 20,000 companies. The knowledge base consists of 274 million pieces of information (RDF triples).http://dbpedia.org/DBpedia and all other linked data is searchable with SPARQLhttp://en.wikipedia.org/wiki/SPARQL20Open Data - a goldmine

Open StreetmapOpenStreetMap is a free editable map of the whole world. It is made by people like you. OpenStreetMap allows you to view, edit and use geographical data in a collaborative way from anywhere on Earth. www.openstreetmap.org21Open Data - a goldmineGeoNamesThe GeoNames geographical database is available for download free of charge under a creative commons attribution license. It contains over eight million geographical names and consists of 6.5 million unique features.www.geonames.org

EnsuringtrulyOpen DataPublic Domain – Only after the expiration of copyrightScience Commons protocol for open data Creative Commons Zero (Link) Public Domain Dedication & Licence(Link)22Open Data - a goldmineFollowthe PDDL Community Norms:Avoid technical protection measures Always give credit where credit is due Use open formats Let others know! Share your work too! Photo by suttonhoo@ Flickr, CC BY-NC-SA

Creative Commons Zero (Link)

Public Domain Dedication & Licence(Link)

Avoid technical protection measures

Always give credit where credit is due

Use open formats

Let others know!

Share your work too!

23Open Data - a goldmineThe road to open knowledge starts here!Questions?Photo by danesparza @ Flickr, CC BY-ND