Getting more out of your big data
Upcoming SlideShare
Loading in...5
×
 

Getting more out of your big data

on

  • 1,236 views

 

Statistics

Views

Total Views
1,236
Views on SlideShare
1,079
Embed Views
157

Actions

Likes
1
Downloads
27
Comments
0

3 Embeds 157

http://datacrunchers.eu 151
http://localhost 4
https://twitter.com 2

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Getting more out of your big data Getting more out of your big data Presentation Transcript

  • Cloud
  • Creating New Business Opportunities GE Revenue Business Operational Growth Innovation1 Efficiencies Increases ad revenue by Measures and ranks online Uses sentiment analysis and processing 3.5 billion user influence by processing web analytics for its internal events per day 3 billion signals per day cloud Massive Cloud Real-Time Volumes Connectivity Insight Processes 464 billion rows Connects across 13 social Improves operational per quarter, with average networks via the cloud for decision making for IT query time under 10 secs. data and API access managers and users 1. Klout Case Study: http://www.microsoft.com/casestudies/Microsoft-SQL-Server-2012-Enterprise/Klout/Data-Services-Firm-Uses-Microsoft-BI-and-Hadoop-to-Boost-Insight-into-Big-Data/710000000129
  • McKinsey GartnerForresterResearch
  • Enabling Innovating new business models, Experimentation to products and services with discover needs, big data expose variability and improve performance Big Data Creating TransparencyReplacing/Supporting human decision making with automated algorithms Segmenting populations to customize actions
  • Data Silos HADOOP DataBusiness Challenges Repository High Velocity Solution changes Internal Data through APIs Fetcher & Parser to enrich & Cost of Changes validate with external data Faster Updates Cost Reduction Solution Benefits Solution Benefits Full dataset refresh possible Significant reduction in every week instead of a few validation phone calls times per year
  • High Volume & HADOOP Real-TimeBusiness Challenges High Velocity Architecture Solution Old solution not able to Scaleable architecture to handle incoming volumes of support current and future data in timely manner real-time insight needs Faster Insights Grow with Needs Solution Benefits Solution Benefits Realtime handling of the Solution scales with business growing Volume & Velocity of needs without upfront cost the data. Adding at least 1TB per year.
  • High Variety & HADOOP Data &Business Challenges High Volume Processing Cluster Solution Scalable Image Library Analyses of 30.000+ giant images of medical scans of Processing cluster to process Pancreas images Faster Research & Cost Friendly Solution Benefits Diagnostical Insight ReliabilitySolution Benefits Improvement Diagnoses can be validated against previous diagnoses Inexpensive data duplication over HADOOP storage nodes New research ideas can be provides needed reliability checked across full image set improvements
  • HDInsight - Microsoft’s approach to Big Data Immersive Insight, Connecting Any Data, Any Size Wherever you are with the World’s Data Anywhere Analyze Big Data with familiar tools Share your data with the world via Simplicity and manageability of Azure Marketplace Windows to Hadoop Immersive insights from any data Enrich with social media data via Social Extended data warehousing with JavaScript based simple programming Analytics Hadoop Advanced analytics with Hadoop Scale & elasticity of cloud
  • Benefits Familiar BI tools with structured and unstructured dataKey Features Hive Excel Plugin, ODBC Driver integrates Hadoop to SQL Server Analysis Services, PowerPivot, and Power View
  • Integration with Microsoft Enterprise Data WarehousesBenefits Deeper insights from structured and Integration with enterprise BI unstructured data solutionsKey Features Microsoft SQL Server connector SQL Server Parallel Data Warehouse for Apache Hadoop with SQOOP connector for Apache Hadoop with (SQL to Hadoop) SQOOP
  • Benefits New business insights with Unlock rare patterns from bespoke data predictive analytics from Microsoft mining modelsKey Features Hive ODBC Driver connects Hadoop Support for open source predictive to SQL Server Data Mining tools analytics tools such as R and Mahout
  • Benefits Sharing of data and Mashing up of internal and insights through Windows public data sets via Data Azure Marketplace ExplorerKey Features Integration with Windows Integration with third-party Azure Marketplace data and services
  • Stronger customer relationshipsBenefits Models augmented with Integration of social publicly available data information with from social media sites business applicationsKey Features Social Analytics Integration with social media sites
  • BenefitsMicrosoft HDInsight Simplified management of Enterprise-class Easy setup on-premises Hadoop on Windows security and in the cloud Smart packaging of Key Features Hadoop on premises Fast deployment of Hadoop on Azure Integration with Integration with Microsoft System Windows Server® 100% Microsoft Support Center Active Directory
  • Benefits Elastic peta-scale Enterprise-class Big DataMicrosoft HDInsight analytics on Microsoft’s platform on-premises cloud platform Key Features Hadoop-based Service on Hadoop-based distribution Windows Azure platform on Windows Server
  • 1. Take a large problem and divide it into sub-problems …MAP 2. Perform the same function on all sub-problems … DoWork() DoWork() DoWork() 3. Combine the output from all sub-problemsREDUCE … Output
  • spanning relational and non-relational Worlds INSIGHTS SELF-SERVICE MOBILE OPERATIONAL REAL-TIME PREDICTIVE COLLABORATIVE and Services External Data MARKETPLACE DATA ENRICHMENT DISCOVER TRANSFORM SHARE AND RECOMMEND AND CLEAN AND GOVERN DATA MANAGEMENT 1 011 01 RELATIONAL NON-RELATIONAL MULTIDIMENSIONAL STREAMING
  • ObjectivesScoping Starter Offer Who Delivers Expected OutcomeCustomer Structured (+- 4/5weeks) Microsoft Define Big DataMeeting to engagement that Consultingdiscuss Big demonstrates the Company Strategy Services &Data Needs capabilities of the Industry Implement Big Data& Scoping Microsoft Big Data Experts Prototype solutionfor Starter platform with a prototypeOffer using real customer data