Big Data From Microsoft and Atidan
 

Big Data From Microsoft and Atidan

on

  • 909 views

 

Statistics

Views

Total Views
909
Views on SlideShare
909
Embed Views
0

Actions

Likes
0
Downloads
42
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Big Data From Microsoft and Atidan Big Data From Microsoft and Atidan Presentation Transcript

  • Social Sentiment BIG DATA Audio / VideoPetabytes Wikis / Blogs Sensors / RFID / Devices Log Files Click Stream Spatial & GPS Coordinates Mobile WEB 2.0 Collaboration Terabytes Data Market Feeds Advertising eCommerce Digital Marketing Gigabytes ERP / CRM Search Marketing eGov Feeds Payables Contacts Web Logs Weather Payroll Deal Tracking Megabytes Recommendations Text/Image Inventory Sales Pipeline Data Complexity: Variety and Velocity 1
  • What’s the socialsentiment for my How do I betterbrand or products predict future outcomes? How do I optimize my fleet based on weather and traffic patterns?
  • Increases ad revenue by processing 3.5 Measures and ranks online user influence Uses sentiment analysis and web analyticsbillion events per day by processing 3 billion signals per day for its internal cloudMassive Volumes Cloud Connectivity Real-Time InsightProcesses 464 billion rows per quarter, with Connects across 15 social networks via the Improves operational decision making foraverage query time under 10 secs. cloud for data and API access IT managers and users
  • MANAGE ANY DATA, ANY SIZE, ANYWHERE 010101010101010101 1010101010101010 01010101010101 101010101010
  • E.g. STRUCTURED & UNSTRUCTURED DATA Extremely large volume of unstructured web logs Ad hoc analysis of logs to prototype patterns Hadoop data cluster feeds large 24TB cube Business users analyze cube data
  • OPEN & FLEXIBLE100% compatible with Tools from a rich Built with closeApache Hadoop ecosystem of partners community collaboration The Apache Software Foundation Hadoop for WindowsAccelerating the delivery JavaScript librariesof Hadoop for Windows Hive ODBC drivers
  • ENRICH BY CONNECTING TO THE WORLDS DATA Refine Discover Combine
  • DISCOVER DATAFROM TO IDENTITY DATA EXPLORER DOC CONTEXT DATA HUB SOCIAL GRAPHS
  • POWER OF COMBINING THE WORLDS DATA Value
  • REFINE DATAEnterprise Information Management & Full Analytic Spectrum
  • E.g. VALUE OF EXTERNAL DATA
  • INSIGHTS ON ANY DATA, ALL USERS, WHEREVER THEY ARE 010101010101010101 1010101010101010 01010101010101 101010101010
  • DEMO: FROM DATA TO INSIGHTS!
  • INSIGHTS FOR ALL USERS THROUGH FAMILIAR TOOLS PB TB GB
  • BIG DATA REQUIRES AN END-TO-END APPROACH INSIGHTS SELF-SERVICE | COLLABORATIVE | MOBILE | REAL-TIME DATA ENRICHMENT DISCOVER TRANSFORM SHARE AND RECOMMEND AND CLEAN AND GOVERN DATA MANAGEMENT 1 011 01 RELATIONAL NON-RELATIONAL STREAMING
  • PowerPivotParallel Data Warehouse Power View Hadoop on Windows
  • ADDITIONAL RESOURCES LEARN MORE 1. Microsoft Big Data Solution: www.microsoft.com/bigdata 2. Windows Azure: www.windowsazure.com/en-us/home/scenarios/big-data 3. Microsoft BI blog: http://blogs.msdn.com/b/microsoft_business_intelligence1/ TRY NOW 1. Preview of the Hadoop-based service for Windows Azure: https://www.hadooponazure.com
  • 8 6.5 6 39% compound Billions $ 5.1 4 3.9 annual growth 2.7 2 rate2 0 2012 2013 2014 2015 Big Data Software Growth 6 4.6 34% compound Billions $ 449% of top CEOs and CIOs are 2.5 3.4 annual growth 2currently using Big Data for 1.8 ratecustomer analytics 0 2012 2013 2014 2015 1. McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, 2012 2. IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast , 2012
  • MICROSOFT BIG DATAAny Data, Any Size Connecting Immersive Insight,Anywhere with the World’s Data Wherever you are Discover data with Data Explorer Immersive insights for all usersExtend data warehouse with Hadoop Combine with information from Insights on any dataWindows simplicity for Hadoop other sources via Azure Marketplace Embedded insights with simplifiedScale & elasticity of the cloud Refine with Advanced Analytics programming
  • MICROSOFT BIG DATAAny Data, Any Size Connecting Immersive Insight,Anywhere with the World’s Data Wherever you are Discover data with Data Explorer Immersive insights for all usersExtend data warehouse with Hadoop PowerPivot Combine with information from Insights on any dataWindows simplicity for Hadoop other sources via Azure Marketplace Embedded insights with simplifiedScale & elasticity ofWarehouse Parallel Data the cloud Refine with Advanced Analytics programming Power View
  • TRADITIONAL NEWRelational Database Management System Petabyte-Scale Services
  • Industry/Vertical Scenarios  Modeling True Risk  Threat AnalysisFinancial Services  Fraud Detection  Trade Surveillance  Credit scoring and analysis  Recommendation Engines  Ad TargetingWeb & E-Tailing  Search Quality  Abuse and click fraud detection  Point of Sales Transaction AnalysisRetail  Customer Churn Analysis  Sentiment Analysis  Customer Churn Prevention  Network Performance optimizationTelecommunications  Call Detail Record (CDR) Analysis  Analyzing Network to Predict FailureGovernment  Fraud Detection and Cyber SecurityGeneral (Cross Vertical)  ETL & Processing Engine
  • WHILE DRAMATICALLY SIMPLIFYING PROGRAMMINGON HADOOP MapReduce programs in Benefits JavaScript Simplified Simplified deployment of programming MapReduce jobs Key Features JS Deploy JavaScript Hadoop jobs Integration with .NET and new from a simple web browser on JavaScript libraries for Hadoop any supported device
  • HADOOP ON PREMISES AND IN THE CLOUD Elastic Big Data platform Extend your EDW Enterprise-class Big Data in the cloud with Big Data platform on-premises Hadoop connectors for Hadoop-based distribution Hadoop-based Service on SQL Server on Windows Server Windows Azure platform
  • MANAGE ANY DATA, ANY SIZE ANYWHERE 1010101010101010 01010101010101 101010101010 Hadoop Connectors & ETL
  • SIMPLICITY AND MANAGEABILITY OF WINDOWS FOR HADOOP Simplified management Enterprise-class security Easy setup on-premises and in the cloud Smart packaging of Hadoop on Windows Integration with Microsoft Integration with Windows Hadoop-based service on System Center Server® Active Directory Windows Azure
  • STREAMING DATA WITH STREAMINSIGHT On-premises analysis of streaming Cloud designed analysis of streaming data in real time data StreamInsight SQL StreamInsight Complex Event Processing with Event Processing in the Cloud with SteamInsight (On-premise) Windows Azure SQL StreamInsight
  • EXTEND YOUR DATA WAREHOUSE WITH HADOOP Integration with Microsoft Data Warehousing Deeper insights from structured Integration with and unstructured data enterprise BI solutions SQL Server Parallel Data Warehouse connector for Apache Hadoop with Microsoft SQL Server SQOOP connector for Apache Hadoop with SQOOP (SQL to Hadoop)
  • CONNECT HADOOP TO THE WORLDVIA WINDOWS AZURE MARKETPLACESharing of data andinsights through Windows Mashing up of internal andAzure Marketplace public data setsIntegration with WindowsAzure Marketplace Integration with third-partythrough ODATA data and services
  • ENRICHMENT VIA INTEGRATION WITH SOCIAL MEDIA Stronger customer relationships Models augmented with Integration of social publicly available data media data with from social media sites business applications Microsoft Codename "Social Analytics" Integration with social media sites
  • ADVANCED ANALYSIS WITH HADOOP New business insights with predictive Unlock rare patterns from bespoke data analytics from Microsoft mining models Support for open source Advanced Analytics tools such as Mahout & Pegasus Mahout & Pegasus libraries Hive ODBC Driver connects Hadoop to already supported on SQL Server Data Mining tools in SSAS Azure
  • MICROSOFT ENTERPRISE DATA WAREHOUSING Software Reference Architectures Appliances Dell Parallel HP Enterprise Data Data Warehouse Warehouse Fast Track for Dell HP Business Quickstart Data Data Warehouse Warehouse
  • 11/24/2010 © Microsoft Corporation, All rights reserved