Big Data, Linked Data

Big Data, Linked Data Paul Miller The Cloud of Data paul.miller@cloudofdata.comcloudofdata.com

Data Big Data Linked Data Opportunities for Audio-Visual Archivescloudofdata.com

Datacloudofdata.com

cloudofdata.com

Talis Libraries SemWeb Cultural Research Heritage SemTech JISC-land EC ! Cloudcloudofdata.com inmaps.linkedinlabs.com

cloudofdata.com inmaps.linkedinlabs.com

“Every two days now we create as much information as we did from the dawn of civilisation up until 2003”cloudofdata.com

cloudofdata.com

Cost per Gb of storage ($)300,000200,000100,000 0 1981 1983 1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009cloudofdata.com

Cost per Gb of storage ($)300,000200,000100,000 0 1981 1983 1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009cloudofdata.com isen.com/blog/2011/03/the-decline-and-fall-of-disk-storage-prices/

cloudofdata.com www.datacenterknowledge.com/wp-content/uploads/2009/09/aerial-1000.jpg

Big Datacloudofdata.com

Cnut knew trying to control the tide was silly cloudofdata.com www.flickr.com/photos/30591976@N05/3402395112/

why not use language of opportunity? cloudofdata.com www.flickr.com/photos/73645804@N00/2712985768/

why not use language of opportunity? “data-driven organisations look at big data as a solution, not a problem” Release 2.0, February 2009 cloudofdata.com www.flickr.com/photos/73645804@N00/2712985768/

cloudofdata.com r2.oreilly.com/

Massively Parallel Processing (MPP) Column stores MapReduce/ Hadoop NoSQLcloudofdata.com r2.oreilly.com/

emerging from lots of places, and being combined cloudofdata.com www.flickr.com/photos/98274023@N00/2102067531/quantity, nature, expectations...

emerging from lots of places, and being combined More data, faster... cloudofdata.com www.flickr.com/photos/98274023@N00/2102067531/quantity, nature, expectations...

Real-Time Web cloudofdata.com

Sensor Web - 15 Petabytes per year ? cloudofdata.com www.flickr.com/photos/7702002@N08/2293062616/

Sensor Web - 15 Petabytes per year ? 15,000,000,000,000,000 cloudofdata.com www.flickr.com/photos/7702002@N08/2293062616/

Sensor Web - 15 Petabytes per year ? 15,000,000,000,000,000 125,000 iPods cloudofdata.com www.flickr.com/photos/7702002@N08/2293062616/

Sensor Web cloudofdata.com www.flickr.com/photos/aroberts/3035796/

Sensor Web Image © Apple cloudofdata.com www.flickr.com/photos/aroberts/3035796/

cloudofdata.com

cloudofdata.com gigaom.com/2011/02/01/mining-the-tar-sands-of-big-data/

Linked Datacloudofdata.com

Today’s a “Web of Documents” ?cloudofdata.com www.flickr.com/photos/calliope/306564541/

Tomorrow’s “Semantic Web,” 2001-style! cloudofdata.com www.sciam.com/article.cfm?id=the-semantic-web

Tomorrow’s “Semantic Web,” 2001-style! http://tr.im/timbl http://tr.im/hendler cloudofdata.com www.sciam.com/article.cfm?id=the-semantic-web

Pipe Dream?cloudofdata.com

Or are the pieces falling into place?cloudofdata.com

W3C-driven effort. More used - and useful - than PR might imply URI - 1994 XML - 1998 RDF - 1999/ 2004 OWL - 2004 SPARQL - 2008 Applications - 2007/8 cloudofdata.com Image © World Wide Web Consortium

“J.R.R. Tolkien wrote The Hobbit”cloudofdata.com

J.R.R. Tolkien wrote The Hobbitcloudofdata.com

J.R.R. Tolkien wrote The Hobbit subject predicate objectcloudofdata.com

J.R.R. Tolkien wrote The Hobbit predicatecloudofdata.com

J.R.R. Tolkien wrote The Hobbit http://blah.org/ThingsAuthorsDo/writecloudofdata.com

J.R.R. Tolkien http://dbpedia.org/page/ J._R._R._Tolkien wrote http://blah.org/ThingsAuthorsDo/write The Hobbit http://dbpedia.org/page/The_Hobbitcloudofdata.com

eg Wikipedia data boxes to DBpediacloudofdata.com

eg UK Gov bit.ly/ztOedcloudofdata.com www.flickr.com/photos/lorentey/1438477358/

eg BBCcloudofdata.com bbc.co.uk/music/

Data LINKED to other places outside ﬁrewalleg BBC trusts and relies upon MusicBrainz bit.ly/9tBJGH cloudofdata.com www.flickr.com/photos/foxypar4/2124673642/

harks back to TimBL’s original vision cloudofdata.com www.flickr.com/photos/tanaka/3212373419/for a Read/Write Web

“the Web done right” Sir Tim Berners-Lee, 2008harks back to TimBL’s original vision cloudofdata.com www.flickr.com/photos/tanaka/3212373419/for a Read/Write Web

Use URIs to name things Use HTTP URIs so that they can be followed When someone follows a URI, provide useful information Include links to other URIs, so that more can be discovered.cloudofdata.com www.w3.org/DesignIssues/LinkedData.html

cloudofdata.com richard.cyganiak.de/2007/10/lod/

Opportunitiescloudofdata.com

cloudofdata.com

Web-scale tools NoSQL data manipulation with Hadoop, Cassandra, etccloudofdata.com

Web-scale tools NoSQL data manipulation with Hadoop, Cassandra, etc Web-scale storage and compute Separate archival role from analysis, dissemination and use “too cheap to meter” may be measuring the wrong thingscloudofdata.com

Web-scale tools NoSQL data manipulation with Hadoop, Cassandra, etc Web-scale storage and compute Separate archival role from analysis, dissemination and use “too cheap to meter” may be measuring the wrong things Leverage connections between archives, and with the wider world embrace the Web, and its architecturecloudofdata.com

cloudofdata.com www.flickr.com/photos/11962592@N00/4549097414/

cloud of data Thank you Download this presentation slideshare.net/cloudofdata Dr Paul Miller The Cloud of Data paul.miller@cloudofdata.com skype: cloudofdata Made on a phone: +44 7769 740083 Mac Except where otherwise noted, this work is licensed under the Creative Commons Attribution Licence. To view a copy of this licence, visit creativecommons.org/licenses/by/2.0/uk/ or send a letter tocloudofdata.com Creative Commons, 171 Second St, San Francisco, CA 94105, United States of America

Big Data, Linked Data

by Paul Miller

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 2

Statistics

Big Data, Linked Data Presentation Transcript