• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Getting more out of your big data
 

Getting more out of your big data

on

  • 404 views

A presentation we gave together with Microsoft at the latest inspirience days in Belgium.

A presentation we gave together with Microsoft at the latest inspirience days in Belgium.

Statistics

Views

Total Views
404
Views on SlideShare
387
Embed Views
17

Actions

Likes
0
Downloads
16
Comments
0

1 Embed 17

http://datacrunchers.eu 17

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Getting more out of your big data Getting more out of your big data Presentation Transcript

    • Cloud
    • Creating New Business OpportunitiesRevenueGrowthIncreases ad revenue byprocessing 3.5 billionevents per dayMassiveVolumesProcesses 464 billion rowsper quarter, with averagequery time under 10 secs.BusinessInnovation1Measures and ranks onlineuser influence by processing3 billion signals per dayCloudConnectivityConnects across 13 socialnetworks via the cloud fordata and API accessOperationalEfficienciesUses sentiment analysis andweb analytics for its internalcloudGEReal-TimeInsightImproves operationaldecision making for ITmanagers and users1. Klout Case Study: http://www.microsoft.com/casestudies/Microsoft-SQL-Server-2012-Enterprise/Klout/Data-Services-Firm-Uses-Microsoft-BI-and-Hadoop-to-Boost-Insight-into-Big-Data/710000000129
    • GartnerMcKinseyForresterResearch
    • Big Data Creating TransparencyEnablingExperimentation todiscoverneeds, exposevariability andimproveperformanceSegmenting populations tocustomize actionsReplacing/Supporting humandecision making withautomated algorithmsInnovating new businessmodels, products andservices with big data
    • HADOOP DataRepositoryInternal Data through APIsFetcher & Parser to enrich &validate with external dataData SilosHigh VelocitychangesCost of ChangesBusinessChallengesSolutionSolutionBenefitsFaster UpdatesFull dataset refresh possibleevery week instead of a fewtimes per yearCost ReductionSignificant reduction invalidation phone callsSolutionBenefits
    • HADOOP Real-TimeArchitectureScaleable architecture tosupport current and futurereal-time insight needsHigh Volume &High VelocityOld solution not able tohandle incoming volumes ofdata in timely mannerBusinessChallengesSolutionSolutionBenefitsFaster InsightsRealtime handling of thegrowing Volume & Velocity ofthe data. Adding at least 1TBper year.Grow with NeedsSolution scales with businessneeds without upfront costSolutionBenefits
    • HADOOP Data &Processing ClusterScalable Image LibraryProcessing cluster to processimagesHigh Variety &High VolumeAnalyses of 30.000+ giantimages of medical scans ofPancreasBusinessChallengesSolutionSolutionBenefitsFaster Research &Diagnostical InsightDiagnoses can be validatedagainst previous diagnosesNew research ideas can bechecked across full image setCost FriendlyReliabilityImprovementInexpensive data duplicationover HADOOP storage nodesprovides needed reliabilityimprovementsSolutionBenefits
    • Share your data with the world viaAzure MarketplaceEnrich with social media data via SocialAnalyticsAdvanced analytics with HadoopConnectingwith the World’s DataAnalyze Big Data with familiar toolsImmersive insights from any dataJavaScript based simple programmingImmersive Insight,Wherever you areSimplicity and manageability ofWindows to HadoopExtended data warehousing withHadoopScale & elasticity of cloudAny Data, Any SizeAnywhereHDInsight - Microsoft’s approach to Big Data
    • Hive Excel Plugin, ODBC Driver integratesHadoop to SQL Server AnalysisServices, PowerPivot, and Power ViewFamiliar BI tools with structured andunstructured dataBenefitsKeyFeatures
    • Integration with enterprise BIsolutionsMicrosoft SQL Server connectorfor Apache Hadoop with SQOOP(SQL to Hadoop)Integration withMicrosoft EnterpriseData WarehousesSQL Server Parallel Data Warehouseconnector for Apache Hadoop withSQOOPDeeper insights fromstructured andunstructured dataBenefitsKeyFeatures
    • Unlock rare patterns from bespoke datamining modelsSupport for open source predictiveanalytics tools such as R and MahoutNew business insights withpredictive analytics from MicrosoftHive ODBC Driver connects Hadoopto SQL Server Data Mining toolsBenefitsKeyFeatures
    • Mashing up of internal andpublic data sets via DataExplorerIntegration with third-partydata and servicesSharing of data andinsights through WindowsAzure MarketplaceIntegration with WindowsAzure MarketplaceBenefitsKeyFeatures
    • Integration of socialinformation withbusiness applicationsSocial AnalyticsStronger customerrelationshipsIntegration with socialmedia sitesModels augmented withpublicly available datafrom social media sitesBenefitsKeyFeatures
    • MicrosoftHDInsightEnterprise-classsecurityIntegration withMicrosoft SystemCenterIntegration withWindows Server®Active DirectorySimplifiedmanagement ofHadoop on WindowsSmart packaging ofHadoop on premisesFast deployment ofHadoop on Azure100% Microsoft SupportEasy setup on-premisesand in the cloudBenefitsKeyFeatures
    • MicrosoftHDInsightElastic peta-scaleanalytics on Microsoft’scloud platformHadoop-based Service onWindows Azure platformEnterprise-class Big Dataplatform on-premisesHadoop-based distributionon Windows ServerBenefitsKeyFeatures
    • 1. Take a large problem and divide it into sub-problems2. Perform the same function on all sub-problems3. Combine the output from all sub-problems……OutputMAPREDUCEDoWork() DoWork() DoWork()…
    • spanning relational and non-relational WorldsNON-RELATIONAL100111DATA MANAGEMENTSHAREAND GOVERNDISCOVERAND RECOMMENDTRANSFORMAND CLEANINSIGHTSDATA ENRICHMENTOPERATIONALSELF-SERVICE MOBILEPREDICTIVEREAL-TIMECOLLABORATIVEMARKETPLACEExternalDataandServicesRELATIONAL MULTIDIMENSIONAL STREAMING
    • ObjectivesStarter OfferStructured (+- 4/5weeks)engagement thatdemonstrates thecapabilities of theMicrosoft Big Dataplatform with a prototypeusing real customer dataWho DeliversMicrosoftConsultingServices &IndustryExpertsExpected OutcomeDefine Big DataCompany StrategyImplement Big DataPrototype solutionCustomerMeeting todiscuss BigData Needs& Scopingfor StarterOfferScoping
    • At your service