Big Data and Internet of Things for
Managers
PeadarCoyle
@springcoil
Who am I?Who am I?
Keynote,SpeakerandTeacheratconferencesthroughout
Europe
Industryworkand'bigdata'blogger forseveralyears
Co-organizerofDataScienceMeetupinLuxembourg
Who do I work for?Who do I work for?
IworkintheProductteamasaDataScientistforJobTODAY
We'reaVC-backedrecruitmentappbasedinLuxembourg
www.jobtoday.com
So how come I care about data?So how come I care about data?
Well I always loved science.Well I always loved science.
I wanted to be a neuroscientistI wanted to be a neuroscientist
Then I fell in love with MathematicsThen I fell in love with Mathematics
I studied Quantum Mechanics at Bristol andI studied Quantum Mechanics at Bristol and
Mathematics in LuxembourgMathematics in Luxembourg
This gets a bit complicated...This gets a bit complicated...
And my cat was never much use...And my cat was never much use...
Along the way I learned someAlong the way I learned some
programming and other skills...programming and other skills...
I needed to find a careerI needed to find a career
And I decided Academia wasn't for me.And I decided Academia wasn't for me.
So I became a data scientist!So I became a data scientist!
Aimsofthetalk
Explainthesubstancebehindthephrase'bigdata'
Tellyouhowyoucanusedatainyourbusiness.
Helpyouunderstandtheimportanceofdatainyourbusiness
strategy.
What is a data scientist?What is a data scientist?
AstatisticianwholivesinSanFrancisco
AdataanalystwholivesinNewYork
DataScienceisstatisticsonaMac.
Adatascientistissomeonebetteratstatisticsthanany
softwareengineerandbetteratsoftwareengineeringthanany
statistician.
http://datascopeanalyticscom/what-we-think/2014/02/05/what-is-a-data-scientist
Why am I talking about this?Why am I talking about this?
What is the competitive advantage?What is the competitive advantage?
Massivelypersonalisedonlineexperiences
'Datamoats'arehardtocopy
AmazonAmazon: Supply chain and: Supply chain and
warehouse modelswarehouse models
Selecting 'House of Cards'Selecting 'House of Cards'
Source:Netflix
Idea:NetflixknewthatDavidFincherfanslikedpolitical
dramas,andthatKevinSpaceywasverypopular-from
analysingvideoplayingdata,andcustomerpreferences
HR AnalyticsHR Analytics
Predictiveanalyticsofwhowouldleaveyourfirm
So, who is talking aboutSo, who is talking about Big DataBig Data??
"Weprojectaneedfor1.5millionadditional
managersandanalystsintheUnitedStateswho
canasktherightquestionsandconsumethe
resultsoftheanalysisofBigDataeffectively."-
,McKinseyreport
Bigdata:Thenextfrontierforinnovation,
competition,andproductivity
Who else?Who else?
Gartner says 'Data is the new oil'Gartner says 'Data is the new oil'
But talk is cheap...But talk is cheap...
Bigdataisliketeenagesex:everyonetalksabout
it,nobodyreallyknowshowtodoit,everyone
thinkseveryoneelseisdoingit,soeveryone
claimstheyaredoingit...-
ProfessorDanAriely-DukeUniversity
Example: LinkedinExample: Linkedin
But I work in the real world not online!But I work in the real world not online!
UPSusesdatafromtheInternetofThingstotravelmore
efficientlyandsavemillionsonfuelconsumption.
So what other areas?So what other areas?
Thesearecasestudiesfromvariousmarketsegments
Theaimistohelpyoubrainstormapplications
Happytoansweranyquestionsafterwards
How do you recommend books?How do you recommend books?
Use Machine Learning!Use Machine Learning!
Preventative Maintenance forPreventative Maintenance for
WindmillsWindmills
Siemens are leveraging IoT dataSiemens are leveraging IoT data
'Source:EnglishWikipedia,originalupload15July2004by
-CreativeCommonsSharealikelicenseLeonardG.
Web Crawling and ScrapingWeb Crawling and Scraping
ZalandotheGermanfashione-commercecompany arescraping
millionsofwebsitestofindtrends.
Audio and visual dataAudio and visual data
Spotifyusessounddataintheirrecommendations!
Social media dataSocial media data
Fashion - Image AnalysisFashion - Image Analysis
Lyst.comleveragenovelhuman-in-the-looprecommendation
engines,recommendonthebasisofcoloursofclothes,anddo
cutting-edgeimageanalysiswithdeeplearning
alltoprovidevalueinFashion-Tech.
Recruitment dataRecruitment data
Howdoyoudisruptrecruitmentforblue-collarwork?
Onewayisbyleveraging'bigdata'todeliverbetterpersonalised
experiences,optimisethespendofmarketingbudgetand
reducecustomerchurn.
What about Metadata?What about Metadata?
Genomicsandhealthdataaretoo.
Healthcare dataHealthcare data
Even in Food...Even in Food...
MonsantoCEOrecentlysaid'datascienceispartofourgrowth
strategy'
MonsantoleveragesClimateCorpsalgorithmstoup-sell
fertiliserandotherservices
I hope you can see that there is...I hope you can see that there is...
Sowhygooddataanalysisishard?
Gettingdataishard
Buildingmodelsishard
Askingtherightbusinessquestionsisevenharder
Ioftenhavetoborrowlotsofpeoplesbrainstogetto
therightbusinessquestions...
Pick the right methodology for the jobPick the right methodology for the job
Text->topicmodelling,sentimentanalysis,information
extraction
E-commercedata->prospensityanalysis,collaborative
filtering
Multimedia->speech-to-text,audiofingerprinting,face
recognition
Clickstreamlogs->frequentpatternmining,sequenceanalysis
Yieldoptimisation->Optimisationmodels,weather
forecasting
Proton-protoncollisionfromLHC->Ihavenoideadespite
havingaPhysicsdegree
Andthenwhat?Wellyoucantellstorieswithvisualizations...
ButDataScientistsdon'tjustproducereports
Theyproducedataproductstoo.
Sowhatisadataproduct?
WellI'mgladyouasked...
What is a data product?What is a data product?
Adataproductprovidesactionableinformationwithoutexposing
decisionmakerstotheunderlyingdataoranalytics.
Examplesinclude:MovieRecommendations,Weather
Forecasts,StockMarketPredictions,ProductionProcess
Improvements,HealthDiagnosis,FluTrendPredictions,Targeted
Advertising.
–MarkHerman,etal.,FieldGuidetoDataScience
Here is an Example from Mailchimp:Here is an Example from Mailchimp:
When should I send that email?When should I send that email?
And produce a magic button :)And produce a magic button :)
Case Study - Marketing Analytics: InCase Study - Marketing Analytics: In
the Game Industrythe Game Industry
1)Usesgamersplaydatatooptimizemarketing
communicationsacrosschannels.-Customersegmentation
modelling
2)BuildingPersonalizationEngineRulesfor1:1
communicationswithindividualgamers.Tohelpreducecustomer
churn.
3)Predictsgamerslikelihoodtochurnortorespondto
up-selloffers.
ExampleExample
Hereisagraphofactiveusersonanonlinegame.Marketing
teamsusetoolslikethistomonitortheircustomersinreal-time
Example:Supply Chain ManagementExample:Supply Chain Management
TheseareexamplesfromTableauanexcellentdatascienceproduct-basedonlaptopsizeddata
sets.SimilartomyAmazonwork. Howeverthesecanalsobebuiltwithopensourcetools.
Electricity DemElectricity Demand predictionand prediction
Analysing IoT data for demandAnalysing IoT data for demand
predictionprediction
Andletdatabeyourguide.
So you can do an experimentSo you can do an experiment
User Conversion after a website change.User Conversion after a website change.
..
Example: Financial AnalysisExample: Financial Analysis
Quantopian IncQuantopian Inc
Leveragingbigdatatobetterassesstheefficiencyoftrading
algorithms.
QuantopianIncisbuildingacrowd-sourcedhedgefundtheygive
theinfrastructure,capitalandresearchtocompetewithWall
Street.
Example: Moving average of AAPLExample: Moving average of AAPL
Especiallywithchangesinregulation...
Risk is also data science challengeRisk is also data science challenge
Data can be used for NGO'sData can be used for NGO's
Thisisawebappofhousepricesandcommutes,doneforanNGO
inLondonwhowantedtoshowtheeffectsof
changesinhousepricesonpeoplescommutes.
Politics: Hilary ClintonPolitics: Hilary Clinton
DataScientistsforhercampaignhelpoptimisemediabuys,
analysetheeffectofcommunicationandoptimisethedonor
acquisitionstrategy.
So why would I need a data scientist?So why would I need a data scientist?
Youmayalreadyhaveone.Iknownumerousbusiness
intelligence,dataanalysts,businessanalysts,riskanalystswho
AREdatascientists.
Alternativelyyoucanhireadataanalyticsconsultanttohelpyou
getstarted.
ButwhatsignalsshouldIlookfor?
Welltherearemanyanswers...Like...
Does this sound like you?Does this sound like you?
Are you losing customers and not understandingAre you losing customers and not understanding
why?why?
Are you making decisions on the basis of data or onAre you making decisions on the basis of data or on
the basis of 'gut feeling'?the basis of 'gut feeling'?
Are you changing your websites or products on theAre you changing your websites or products on the
basis of data driven experimentation?basis of data driven experimentation?
If you want Interviews with expertsIf you want Interviews with experts
http://bit.ly/1Uks2Rr orwww.peadarcoyle.com
Thank You For ListeningThank You For Listening
Anyquestions?
Reachouttomeifyouhaveanydataquestions.
I'llbedoingatrainingon'bigdata'atNyukosoon.
@springcoil
SearchPeadarCoyleonLinkedin
peadarcoyle@googlemail.com

Big Data and Internet of Things for Managers