Exploiting Data in the Cloud

Exploiting Data in the Cloud - Presentation Transcript

Exploiting Data in the Cloud Dr Paul Miller The Cloud of Data paul.miller@cloudofdata.com cloudofdata.com

cloudofdata.com www.ﬂickr.com/photos/nickwebb/3024917166/

Getting Started cloudofdata.com www.ﬂickr.com/photos/nickwebb/3024917166/

moving infrastructure to Cloud cloudofdata.com www.ﬂickr.com/photos/pallotron/2480365594/

...but why not data? cloudofdata.com www.ﬂickr.com/photos/62327186@N00/2774206139/

‘Security’ - reason or excuse? cloudofdata.com www.ﬂickr.com/photos/himmelundholle/434612787/

re-imagining the Semantic Web cloudofdata.com www.ﬂickr.com/photos/_-amy-_/3167333250/

re-imagining the Semantic Web “Stop hugging your data” Sir Tim Berners-Lee, 2009 http://tr.im/timblvideo cloudofdata.com www.ﬂickr.com/photos/_-amy-_/3167333250/

eg Thomson Reuters cloudofdata.com www.ﬂickr.com/photos/crowbot/2513650642/

eg UK Gov. but ﬁrst… - recap Cloud - introduce ‘Semantic’ or Data Web cloudofdata.com www.ﬂickr.com/photos/lorentey/1438477358/

take a step back cloudofdata.com www.ﬂickr.com/photos/pearbiter/141931319/

take a step back The Cloud cloudofdata.com www.ﬂickr.com/photos/pearbiter/141931319/

cloudofdata.com User perspective ‘Cloud’ means- device/location independence

Image © Apple cloudofdata.com User perspective ‘Cloud’ means- device/location independence

Traditional 3 layer model - there are plenty of others! all ‘Cloud’… but DIFFERENT! Software/Application [as a Service] (SaaS) Platform [as a Service] (PaaS) Infrastructure [as a Service] (IaaS) cloudofdata.com

outsource raw infrastructure - avoid signiﬁcant CapEx scale to meet demand - Eli Lilly, payroll SaaS - IBM Blue Cloud hybrid PaaS Infrastructure as a Service (IaaS) computers (Amazon EC2, Rackspace, GoGrid...) storage (Amazon S3, MobileMe, Google Drive...) Elasticity (Rightscale…) Bandwidth (Limelight, Amazon CloudFront…) Electricity Cooling etc. cloudofdata.com

‘does heavy lifting’ concentrate on your app’s USP SaaS Platform as a Service (PaaS) Salesforce force.com Apprenda SaaSGrid Google App Engine Microsoft Azure Appistry Talis Platform IaaS cloudofdata.com

light weight applications, delivered over Web mostly low-end disruptors for now... Software as a Service (SaaS) Google Apps, Zoho Acrobat.com, iWork.com Kashﬂow, Sage Live WordPress.com MobileMe Salesforce.com PaaS IaaS cloudofdata.com

data are at every level of the stack… becomes more important as the stack commoditises SaaS Data PaaS IaaS cloudofdata.com

Rode Cloud meme in 2008. Listen to our podcast. cloudofdata.com http://tr.im/dzxm

Recent perspective on opportunity cloudofdata.com http://tr.im/gqot

Gradual transition to the Cloud saves money Includes Private Clouds But data in ghettos cloudofdata.com

TimBL’s TED talk reminded me of this... Image © 2008, David Simonds March 2008 Economist Remarkably similar to - and different from - Enterprise data in the Cloud? cloudofdata.com www.economist.com/business/displaystory.cfm?story_id=10880936

cloudofdata.com www.ﬂickr.com/photos/dullhunk/303503677/

The Semantic Web http://tr.im/ﬂqo cloudofdata.com www.ﬂickr.com/photos/dullhunk/303503677/

recent, useful. ore cast Tom Scott on BBC includes ologyf Techn al y journ arterl A qu 2009 g Sprin 32 ateg y for ” I ’s str messy B A CIO king “ rethin eb 20 eman tic W sue In t his is gS Makin ctions conne 04 ata W eb ad ning Spin cloudofdata.com www.pwc.com/techforecast

complex early vision cloudofdata.com www.sciam.com/article.cfm?id=the-semantic-web

complex early vision http://tr.im/timbl http://tr.im/hendler cloudofdata.com www.sciam.com/article.cfm?id=the-semantic-web

URI - 1994 XML - 1998 RDF - 1999/ 2004 OWL - 2004 SPARQL - 2008 Applications - 2007/8 cloudofdata.com Image © World Wide Web Consortium

simple principles, pragmatically applied cloudofdata.com linkeddata.org/

reaches back to TimBL’s original vision of the cloudofdata.com www.ﬂickr.com/photos/tanaka/3212373419/ Read/Write Web

“the Web done right” Sir Tim Berners-Lee, 2008 reaches back to TimBL’s original vision of the cloudofdata.com www.ﬂickr.com/photos/tanaka/3212373419/ Read/Write Web

cloudofdata.com www.opencalais.com/

http://tr.im/pridor http://tr.im/calais4 cloudofdata.com www.opencalais.com/

Slide © 2009, Thomson Reuters 5 Metadata 3 Which provides 1 returned to the information and other Linked Unstructured user with keys Data pointers Text 4 Keys provide access to the Calais Linked Data cloud 2 Calais extracts entities, facts and To a range of open 6 events and partner Linked data assets – possibly including including Thomson Reuters TR in the future cloudofdata.com

NSF, JISC etc getting to grips with massive data sets cloudofdata.com www.diggingintodata.org/

Amazon - ‘public’ data free online, avoiding net work costs of loading data cloudofdata.com aws.amazon.com/publicdatasets/

cut costs, mass produce, standardise - create opportunities for growth cloudofdata.com www.ﬂickr.com/photos/starrett/3123216825/

cut costs, mass produce, standardise - create opportunities for growth Data as Commodity cloudofdata.com www.ﬂickr.com/photos/starrett/3123216825/

data is a cost we treat all data as Core and conﬁdential most actually Context and a commodity cloudofdata.com www.ﬂickr.com/photos/dsifry/2104378305/ Think Different!

“from Data Centre to data-centric” JP Rangaswami, 2009 data is a cost we treat all data as Core and conﬁdential most actually Context and a commodity cloudofdata.com www.ﬂickr.com/photos/dsifry/2104378305/ Think Different!

lots of closed doors some hide monsters! presumption is ‘No’ presumption should be ‘Yes’ cloudofdata.com

What if… -crowdsourced address updates -wisdom of crowds, like GoldCorp mining data in Canada -expose some commercial data, in return cloudofdata.com www.ﬂickr.com/photos/davehamster/531768924/ for beneﬁts from competitor insight

‘The Data Exhaust’ cloudofdata.com www.ﬂickr.com/photos/big-ashb/535904273/

common to try to copyright data… or to use a CC license to ‘do the right thing’. Copyright does not apply, and as CC based on copyright, CC doesn’t work either. © cloudofdata.com

common to try to copyright data… or to use a CC license to ‘do the right thing’. Copyright does not apply, and as CC based on copyright, CC doesn’t work either. X © does not apply cloudofdata.com

Image for illustrative purposes. I am not applying a CC0 license to this presentation. Contract Law works… or initiatives opendatacommons.org cloudofdata.com such as CC0 and Open Data Commons. wiki.creativecommons.org/CCZero

cloudofdata.com www.ﬂickr.com/photos/king-edward/2152782252/

Closing Thoughts cloudofdata.com www.ﬂickr.com/photos/king-edward/2152782252/

cloudofdata.com

most data ‘context’ not ‘core’ but we apply one size ﬁts all thinking… move from a presumption of ‘No’ to a presumption of ‘Yes’ data as commodity; can we let go? cloudofdata.com

most data ‘context’ not ‘core’ but we apply one size ﬁts all thinking… move from a presumption of ‘No’ to a presumption of ‘Yes’ data as commodity; can we let go? Semantic Web thinking lets us address data at Web scale the primacy of the link cloudofdata.com

please… Even NYT did last week “Stop hugging your data” Sir Tim Berners-Lee, 2009 cloudofdata.com www.ﬂickr.com/photos/scobleizer/2510349462/

cloud of data Thank you Download this presentation slideshare.net/cloudofdata Dr Paul Miller The Cloud of Data paul.miller@cloudofdata.com Made on a skype: cloudofdata Mac phone: +44 7769 740083 Except where otherwise noted, this work is licensed under the Creative Commons Attribution Licence. To view a copy of this licence, visit creativecommons.org/licenses/by/2.0/uk/ or send a letter to cloudofdata.com Creative Commons, 171 Second St, San Francisco, CA 94105, United States of America

credit Paul Miller, The Cloud of Data