• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
When Two Seconds Is Too Long
 

When Two Seconds Is Too Long

on

  • 577 views

presentation at the Big DataShow as part of InternetWorld in London April 2013 ...

presentation at the Big DataShow as part of InternetWorld in London April 2013

its an overview of the main technologies used to process big data, and then a review of some real world big data use cases - showing how they map onto the axes of complexity of analytics and responsiveness

Statistics

Views

Total Views
577
Views on SlideShare
577
Embed Views
0

Actions

Likes
0
Downloads
4
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    When Two Seconds Is Too Long When Two Seconds Is Too Long Presentation Transcript

    • WhenTwo Seconds IsToo LongA look at low latency, real-time analyticsVP Product Marketingdai@acunu.com@daicleggdai clegg
    • @daicleggThe new data sources driving big data analytics2mobile marketingsocial appsinfrastructure monitoringbatch reportingexploratory analysisdata discoveryBatch AnalyticsOperational Intelligenceinfrastructure fabric/logssmart grids/smart metersdfid tags, etcsocial mediamobile appsweb clicksMachine DataSocial Data
    • @daicleggTITLE HERE3the Big Data technology landscapedata mining/data warehousingquantitativeanalyticsdata access
    • @daicleggSubtitleTITLE HERE4the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultscomplexity of analyticsuse casemoney-offcouponsdata mining/data warehousingquantitativeanalyticsdata access‣ Identifies items that shoppers are likely tobuy in future visits‣ Coupon redemption rates as high as 24%
    • @daicleggSubtitleTITLE HEREbabies5the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponsdata mining/data warehousingquantitativeanalyticsdata accesscomplexity of analyticsuse case‣ Neo-natal infant monitoring‣ 120 babies monitored‣ 120k messages /second
    • @daicleggSubtitleTITLE HEREbabies6the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata accesscomplexity of analyticsuse case‣ 2.5 petabytes in Hadoop‣ weather data, turbine operational data‣ model weather to optimise wind farms
    • @daicleggSubtitleTITLE HEREbabies7the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata access‣ Neo-natal infant monitoring‣ 120 babies monitored‣ 120k messages /second‣ Global e-store‣ Shopping cart session store‣ 000s of transactions per secondshoppingcartscomplexity of analyticsuse case
    • @daicleggSubtitleTITLE HEREbabiesshoppingcarts8the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata accessHi-tech Mftg‣ automated hi-tech assembly‣ ‘000s of test readings per second‣ comparing results to historic metrics‣ monitoring the test stations’ performancecomplexity of analyticsuse case
    • @daicleggSubtitleTITLE HEREbabiesshoppingcarts9the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata accessHi-tech Mftgtaxiscomplexity of analyticsuse case‣ Neo-natal infant monitoring‣ 120 babies monitored‣ 120k messages /second‣ Real-time visibility of infrastructure‣ Insight delivered into the cab‣ Caught competitor ‘stealing’ web data
    • @daicleggSubtitleTITLE HEREbabiesshoppingcarts10the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata accessHi-tech MftgtaxisSMS Mktg‣ ingesting 300m SMSs daily‣ over 5000 events per second‣ maintaining 90 days history per campaign‣ Oracle/NetApp only supported 45 dayscomplexity of analyticsuse case
    • @daicleggSubtitleTITLE HEREbabiesshoppingcarts11the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillsdata mining/data warehousingquantitativeanalyticsdata accessHi-tech MftgtaxisSMS MktgX-factorcomplexity of analyticsuse case‣ Neo-natal infant monitoring‣ 120 babies monitored‣ 120k messages /second‣ 1000s of votes/boos/applauds per second‣ “we were able to handle our problems with$5,000 and a credit card.” - CTO, Tellybug
    • @daicleggSubtitleTITLE HEREbabiesshoppingcarts12the Big Data technology landscapehours minutes seconds milli-secondsimmediacy of resultsmoney-offcouponswindmillslatest data,historic context,analytic insightdeep analyticsworth the waitdata mining/data warehousingquantitativeanalyticsdata accessHi-tech MftgtaxisSMS MktgX-factorjust need put & getjust need recent datacomplexity of analyticsuse case
    • @daicleggthe Acunu Analytics13AcunuAnalyticsdelay textdelay textProd 4Prod 3Prod 2Ventas Ron RateVentas BSFVentas x VendedorMes en CursoCuentas PorCobrarCuentas PorPagarContabilidadProd 1Acunu Analytics can ingest data,at very high velocity, from anysourceThe data is pre-processed, asit arrives, to filter, transformand enrich it with othercorporate dataAnd aggregated into roll-upcubes of sums, averages, top k,etc, so query answers arealready storedThen, when a dashboardquery is executed, theanswer is there for instantresponseBut not justdashboards; there’s aJSON API so queriescan be embedded inother appsAnd the original data isstored for further analysisand to share with otheranalytic tools
    • ThankYou.VP Product Marketingdai@acunu.com@daicleggdai clegg