Big Data From Microsoft and Atidan

863 views
700 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
863
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
49
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Big Data From Microsoft and Atidan

  1. 1. Social Sentiment BIG DATA Audio / VideoPetabytes Wikis / Blogs Sensors / RFID / Devices Log Files Click Stream Spatial & GPS Coordinates Mobile WEB 2.0 Collaboration Terabytes Data Market Feeds Advertising eCommerce Digital Marketing Gigabytes ERP / CRM Search Marketing eGov Feeds Payables Contacts Web Logs Weather Payroll Deal Tracking Megabytes Recommendations Text/Image Inventory Sales Pipeline Data Complexity: Variety and Velocity 1
  2. 2. What’s the socialsentiment for my How do I betterbrand or products predict future outcomes? How do I optimize my fleet based on weather and traffic patterns?
  3. 3. Increases ad revenue by processing 3.5 Measures and ranks online user influence Uses sentiment analysis and web analyticsbillion events per day by processing 3 billion signals per day for its internal cloudMassive Volumes Cloud Connectivity Real-Time InsightProcesses 464 billion rows per quarter, with Connects across 15 social networks via the Improves operational decision making foraverage query time under 10 secs. cloud for data and API access IT managers and users
  4. 4. MANAGE ANY DATA, ANY SIZE, ANYWHERE 010101010101010101 1010101010101010 01010101010101 101010101010
  5. 5. E.g. STRUCTURED & UNSTRUCTURED DATA Extremely large volume of unstructured web logs Ad hoc analysis of logs to prototype patterns Hadoop data cluster feeds large 24TB cube Business users analyze cube data
  6. 6. OPEN & FLEXIBLE100% compatible with Tools from a rich Built with closeApache Hadoop ecosystem of partners community collaboration The Apache Software Foundation Hadoop for WindowsAccelerating the delivery JavaScript librariesof Hadoop for Windows Hive ODBC drivers
  7. 7. ENRICH BY CONNECTING TO THE WORLDS DATA Refine Discover Combine
  8. 8. DISCOVER DATAFROM TO IDENTITY DATA EXPLORER DOC CONTEXT DATA HUB SOCIAL GRAPHS
  9. 9. POWER OF COMBINING THE WORLDS DATA Value
  10. 10. REFINE DATAEnterprise Information Management & Full Analytic Spectrum
  11. 11. E.g. VALUE OF EXTERNAL DATA
  12. 12. INSIGHTS ON ANY DATA, ALL USERS, WHEREVER THEY ARE 010101010101010101 1010101010101010 01010101010101 101010101010
  13. 13. DEMO: FROM DATA TO INSIGHTS!
  14. 14. INSIGHTS FOR ALL USERS THROUGH FAMILIAR TOOLS PB TB GB
  15. 15. BIG DATA REQUIRES AN END-TO-END APPROACH INSIGHTS SELF-SERVICE | COLLABORATIVE | MOBILE | REAL-TIME DATA ENRICHMENT DISCOVER TRANSFORM SHARE AND RECOMMEND AND CLEAN AND GOVERN DATA MANAGEMENT 1 011 01 RELATIONAL NON-RELATIONAL STREAMING
  16. 16. PowerPivotParallel Data Warehouse Power View Hadoop on Windows
  17. 17. ADDITIONAL RESOURCES LEARN MORE 1. Microsoft Big Data Solution: www.microsoft.com/bigdata 2. Windows Azure: www.windowsazure.com/en-us/home/scenarios/big-data 3. Microsoft BI blog: http://blogs.msdn.com/b/microsoft_business_intelligence1/ TRY NOW 1. Preview of the Hadoop-based service for Windows Azure: https://www.hadooponazure.com
  18. 18. 8 6.5 6 39% compound Billions $ 5.1 4 3.9 annual growth 2.7 2 rate2 0 2012 2013 2014 2015 Big Data Software Growth 6 4.6 34% compound Billions $ 449% of top CEOs and CIOs are 2.5 3.4 annual growth 2currently using Big Data for 1.8 ratecustomer analytics 0 2012 2013 2014 2015 1. McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, 2012 2. IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast , 2012
  19. 19. MICROSOFT BIG DATAAny Data, Any Size Connecting Immersive Insight,Anywhere with the World’s Data Wherever you are Discover data with Data Explorer Immersive insights for all usersExtend data warehouse with Hadoop Combine with information from Insights on any dataWindows simplicity for Hadoop other sources via Azure Marketplace Embedded insights with simplifiedScale & elasticity of the cloud Refine with Advanced Analytics programming
  20. 20. MICROSOFT BIG DATAAny Data, Any Size Connecting Immersive Insight,Anywhere with the World’s Data Wherever you are Discover data with Data Explorer Immersive insights for all usersExtend data warehouse with Hadoop PowerPivot Combine with information from Insights on any dataWindows simplicity for Hadoop other sources via Azure Marketplace Embedded insights with simplifiedScale & elasticity ofWarehouse Parallel Data the cloud Refine with Advanced Analytics programming Power View
  21. 21. TRADITIONAL NEWRelational Database Management System Petabyte-Scale Services
  22. 22. Industry/Vertical Scenarios  Modeling True Risk  Threat AnalysisFinancial Services  Fraud Detection  Trade Surveillance  Credit scoring and analysis  Recommendation Engines  Ad TargetingWeb & E-Tailing  Search Quality  Abuse and click fraud detection  Point of Sales Transaction AnalysisRetail  Customer Churn Analysis  Sentiment Analysis  Customer Churn Prevention  Network Performance optimizationTelecommunications  Call Detail Record (CDR) Analysis  Analyzing Network to Predict FailureGovernment  Fraud Detection and Cyber SecurityGeneral (Cross Vertical)  ETL & Processing Engine
  23. 23. WHILE DRAMATICALLY SIMPLIFYING PROGRAMMINGON HADOOP MapReduce programs in Benefits JavaScript Simplified Simplified deployment of programming MapReduce jobs Key Features JS Deploy JavaScript Hadoop jobs Integration with .NET and new from a simple web browser on JavaScript libraries for Hadoop any supported device
  24. 24. HADOOP ON PREMISES AND IN THE CLOUD Elastic Big Data platform Extend your EDW Enterprise-class Big Data in the cloud with Big Data platform on-premises Hadoop connectors for Hadoop-based distribution Hadoop-based Service on SQL Server on Windows Server Windows Azure platform
  25. 25. MANAGE ANY DATA, ANY SIZE ANYWHERE 1010101010101010 01010101010101 101010101010 Hadoop Connectors & ETL
  26. 26. SIMPLICITY AND MANAGEABILITY OF WINDOWS FOR HADOOP Simplified management Enterprise-class security Easy setup on-premises and in the cloud Smart packaging of Hadoop on Windows Integration with Microsoft Integration with Windows Hadoop-based service on System Center Server® Active Directory Windows Azure
  27. 27. STREAMING DATA WITH STREAMINSIGHT On-premises analysis of streaming Cloud designed analysis of streaming data in real time data StreamInsight SQL StreamInsight Complex Event Processing with Event Processing in the Cloud with SteamInsight (On-premise) Windows Azure SQL StreamInsight
  28. 28. EXTEND YOUR DATA WAREHOUSE WITH HADOOP Integration with Microsoft Data Warehousing Deeper insights from structured Integration with and unstructured data enterprise BI solutions SQL Server Parallel Data Warehouse connector for Apache Hadoop with Microsoft SQL Server SQOOP connector for Apache Hadoop with SQOOP (SQL to Hadoop)
  29. 29. CONNECT HADOOP TO THE WORLDVIA WINDOWS AZURE MARKETPLACESharing of data andinsights through Windows Mashing up of internal andAzure Marketplace public data setsIntegration with WindowsAzure Marketplace Integration with third-partythrough ODATA data and services
  30. 30. ENRICHMENT VIA INTEGRATION WITH SOCIAL MEDIA Stronger customer relationships Models augmented with Integration of social publicly available data media data with from social media sites business applications Microsoft Codename "Social Analytics" Integration with social media sites
  31. 31. ADVANCED ANALYSIS WITH HADOOP New business insights with predictive Unlock rare patterns from bespoke data analytics from Microsoft mining models Support for open source Advanced Analytics tools such as Mahout & Pegasus Mahout & Pegasus libraries Hive ODBC Driver connects Hadoop to already supported on SQL Server Data Mining tools in SSAS Azure
  32. 32. MICROSOFT ENTERPRISE DATA WAREHOUSING Software Reference Architectures Appliances Dell Parallel HP Enterprise Data Data Warehouse Warehouse Fast Track for Dell HP Business Quickstart Data Data Warehouse Warehouse
  33. 33. 11/24/2010 © Microsoft Corporation, All rights reserved

×