Microsoft Data Warehousing


Published on

Overview of data warehousing.

Published in: Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • TfL case study:
  • Week Article:
  • Week Article:
  • “SQL Server 2012 Master Data Services and SQL Server Data Quality Services gives more people within Areva the opportunity to be involved in information management, which provides more trust in the process. As a result, we have much more confidence around our data, and that helps us make stronger business decisions because the data is more aligned with the company’s vision” - DalilaKerkouba, IT Manager, Areva
  • Based on Alinean Study Ongoing administrative costs often make up 70% of IT budgetsOn average SQL Server DBAs were able to install and configure new database servers in 1.5 hours, while Oracle DBAs took 6 hours on average.
  • RAsSome assembly required OR No assembly required (through Partners)FT TrainingUnderstand File System layoutsHow you physically implement DW has to be like the guidelinesApplianceMPP TrainingQueries are differentModeling is differentData structures are differentPartitioning is differentKey decision points:Data Volumes: If you get above 95 TerabytesProcurement and Operation Logistics: What is your HW SKU process? Can you put a brand new HW system onto the data center? Workload Characteristics: Highly concurrent data?DW Organizational Maturity: Do you already know MPP?
  • Next-Gen Performance with Mission Critical AvailabilityFast Track for SQL 2012 provides a generational leap in performance due to the new xVelocity in-memory technologies allowing improvements of 10X-100X for single query execution and measured workload throughputs [at *double Fast Track for SQL Server 2008 R2 rates]. Mission critical availability with AlwaysOn gives Fast Track for SQL 2012 complete fault tolerance and disaster recovery to achieve the required 9s of up time.  *Internal Microsoft testing of FTDW Rated Throughput.  Can also insert Partner numbersOptimized Configuration on Latest HardwareFast Track for SQL 2012 is a reference architecture allowing customers to buy or re-use existing industry standard, tier 1 hardware in a configuration pre-validated for optimal Data Warehousing performance.  Customers have access to the latest generation of servers and storage and cutting edge features of SQL Server 2012. SQL Server Fast Track for Data Warehousing can Scale-Up to meet workload demands between 2 and 95 TB of user data capacity. Partners will include HP, Dell, IBM, EMC, Nimbus, XIO, and Cisco.Fast Track has also been optimized for SSD Hard Drives and can deliver entire reference architectures on SSD.Fast Time To Solution At Lowest CostFast Track for SQL 2012 enables IT staff to get up and running quickly. Pre-validated Reference Architectures eliminate  complex hardware and software balancing and take guesswork out of system configuration. This has saved customers  [like insert FTDW case study reference] months of configuration, setup, testing and tuning.  Fast Track for SQL 2012 combines low cost  of acquisition and ownership  (includes maintenance, IT staffing, installation, configuration, operations). Furthermore, real life scenarios [such as Insert FTDW case study reference] show savings of hundreds of thousands of dollars after migrating to Fast Track.
  • Purpose: Discuss what’s new in PDW AU3Talk Track:10x Performance ImprovementsPredictable query performance with new cost-based Query OptimizerDramatic query performance with new Data Movement ServiceHalf-rack Availability:Half-rack Appliance from Dell now available!HP to ship half-rack appliance by AprilBest in class manageabilityThrough System Center Operations Manager (SCOM) integrationScale your applications from SQL Server to PDWBetter alignment with SQL Server SMP. More easily move your Applications built on SQL Server over to a PDW solution: Supports subset of stored proceduresFull Support for International Data
  • Volvo Aero - Vegas Sands - - Music Group - - Israel Deaconess Medical - - Cytology Service - - Waikiki - - - - - -
  • Week Article:
  • SQL Server 2012 will help unlock new insights with pervasive data discovery across the organization while providing tools for IT to deliver credible, consistent data and large scale analytic and data warehouse solutions.
  • Microsoft Data Warehousing

    1. 1. AGENDA Introduction Next Generation Performance and Availability Insights for Everyone Fastest Time to Solution at Lowest Cost
    2. 2. You’re at a station in an unfamiliar city on business and your train is delayed Your smart phone, aware of the delay, alerts you to the fact that you will be late for your scheduled meeting It offers to direct you to a bus stop, calculating that you can still arrive on time by taking the next bus Instead you decide use an app on your phone that contacts local cab firms and automatically orders a car from the company that can get to you fastest The cab locates you by GPS, gets you to your meeting on time, and the fare is paid automatically via your phone
    3. 3. It’s all about the data warehouse Availability Performance Scale Delivery Scale to house massive volumes of data from multiple sources Answer complex queries almost instantly Ensure that the service remains available at all times Deliver accurate information to any device, any time, and any place
    4. 4. Where are we now? Transport for London has already implemented a Microsoft solution that offers real-time journey options through mobile devices, making it faster and simpler for travellers to find their way around in this very large city “Portable and mobile devices in people’s hands are a great way to help customers benefit from our data. Our challenge is to get information to people in a way that helps them make their journeys better, faster, and less stressful.” - Michael Gilbert, Chief Technology Officer, Transport for London
    5. 5. WHY SQL SERVER FOR DATA WAREHOUSING? power and scalability …the reliability to ensure virtually 100% availability Plus … Increased productivity with integrated tools Credible and consistent data with built-in EIM Easy to use, familiar BI tools Reference architectures and appliance options Fastest time to solution Low cost of acquisition, operation, and maintenance Fast insights with built-in analysis and reporting
    7. 7. LEADERS IN BOTH DATA WAREHOUSING AND BI Challenger s Leaders Niche players Visionaries Completeness of Vision Abilityto Execute Gartner “Microsoft exhibits one of the best value propositions on the market with a low cost and a highly favorable price / performance ratio” - Gartner, February 2012 [Gartner, Inc., Magic Quadrant for Data Warehouse Database Management Systems Magic Quadrant, Mark A. Beyer, Donald Feinberg, Merv Adrian, Roxane Edjlali, February 6, 2012. The Magic Quadrant is copyrighted 2012 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. Challenger s Leaders Niche players Visionaries Completeness of VisionAbilityto Execute Data Warehousing Business Intelligence As of February 2012 As of February 2012
    8. 8. Benefit from a roadmap that enables you to tackle today’s issues and be prepared for the challenges of the future Data explosion – Harness ever increasing volumes of data to gain insights and drive solutions Multiple sources of data – Include all of the data, from unstructured ‘big data’ to cloud-based data, and obtain new and different types of insights Development and Implementation – Experience a fast time to solution and low TCO by using tested reference architectures and pre-built appliances Pervasive business intelligence – Liberate your data and empower workers by opening up BI to everyone Vendor lock-in – Choose the hardware that suits you best and avoid the risks of being locked into a specific hardware vendor Manageability – Reduce management effort and increase productivity with integrated tools
    9. 9. 11
    11. 11. Enterprise Ready ENTERPRISE CLASS AVAILABILITY - Paul Gleason, VP SQL Administration Team
    12. 12. COMPLEX QUERIES AT HIGH CONCURRENCY “ParallelDataWarehouseruns complex queries about 160times faster, providing a dataloadover1Tb/Hour and fully integrates into a completeBI Solution” Benefits • Incredible performance for highly complex queries • High-concurrency environments responsiveness and agility maximum availability
    13. 13. ANALYSIS AND REPORTING AT NO EXTRA COST Proven reporting and analysis tools Multidimensional data models for ‘traditional’ data analysis - Tim Lum, Head of BI, Kelkoo Intuitive report authoring SQL Server Analysis Services SQL Server Reporting Services Tabular data models make it fast and easy to analytics get up and running Comprehensive report management and delivery Interactive, visual reporting with Power View Benefits
    14. 14. Benefits SELF-SERVICE BUSINESS INTELLIGENCE Use the tools that you already own - Dong-Soo Woo, Head of IT Planning, - Heungkuk
    15. 15. Data cleansing and de-duplication Accuracy, trustworthy data Extract, transform, and load data from any industry source - Dalila Kerkouba, IT Manager, - Areva
    16. 16. BIG DATA AND COULD INTEGRATION Improve insights by including all of the data Harness unstructured data such as Word documents, PDF files, pictures, videos, RFID data, and sensor data Hadoop solutions for Windows Server and Windows Azure Connectors move data between SQL Server data warehouse and Hadoop Integrate on-premises data with data stored in the could to deliver the whole picture Combine internal and external data and services with SQL Azure Use familiar tools such as Excel and PowerPivot to gain insights
    17. 17. LOWEST TOTAL COST OF OWNERSHIP Save hundreds of thousands on new licence and maintenance costs by migrating to SQL Server Fastest time to solution with Appliances or RAs Save hundreds of thousands of dollars on new license and maintenance costs Monitor HW and SW with single tool Key components of Business Intelligence and Enterprise Information Management at no extra cost Open industry hardware your staff already knows -Dale Danilewitz, CIO, AmerisourceBergen Save Hundreds of Thousands of Dollars
    18. 18. FASTER DEPLOYMENT TIME A major component of TCO for a data warehouse is the cost of planning and deployment … DBMS Installation Configuration Security Integration Total SQL Server 22 34 18 14 88 minutes Oracle 48 165 38 106 357 minutes SQL Server and Oracle Database deployment times in minutes * * Installation – Initial installation of the database software on the server Configuration – Creation of database schema and specification of database instance settings Security – Definition of security settings for the database Integration – Integration of the database with the infrastructure, including backup processes -Staffan Zackrisson, President and CEO, Volvo Aero … SQL Server has a faster deployment time than major vendors
    19. 19. REFERENCE ARCHITECTURES AND APPLIANCES Choice of Form Factors: Eliminate planning and deployment times Pre-tested and tuned reference architectures based on commodity hardware from major partners Certified with 7 open industry standard HW partners .” - Jordan Zommick, Executive Director of Enterprise Architecture and Development, Las Vegas Sands Fast Track Data Warehouse High-performance, high-concurrency data warehouse appliances Co-engineered with open industry standard hardware Parallel Data Warehouse
    20. 20. Monitor Data Warehouse hardware and software through single tool: System Center TAKE CONTROL Better manageability, greater productivity, lower TCO Integrated tools enable management of all aspects of your data warehouse with minimal training Increase backup speeds and reduce backup storage with backup compression Up to 15,000 partitions, enabling you to better manage the data lifecycle “By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.” - Mark Underwood, Second Vice President, Protective Life Corporation
    21. 21. Summary   
    22. 22. DATA WAREHOUSING AT ANY SCALE  A choice of form factors and hardware  Start small and grow Self Build Business Data Warehouse Fast Track Reference Architectures Parallel Data Warehouse Half Rack Parallel Data Warehouse Full Rack Effort to Build Variable Very low Moderate Very low Very low Capacity Variable 5TB 14TB – 95TB 80TB 500TB + Concurrency Variable Light Light – high Very high Very high Query Complexity Variable Medium Medium – high Very high Very high Architecture SMP SMP SMP MPP MPP Form factor Software only Appliance Reference Architecture Appliance Appliance
    23. 23. Flexibility and Choice 29 Customers acquire and tune the software to their own hardware without guidance. Offerings • SQL Server 2012 • SQL Server 2008 R2 Effort to build Tuning Flexibility in configuration Initial Price Investment Variable to High Mid High Low Deliver hardware and software separately containing pre-tested, pre-tuned configuration best practices Offerings • Fast Track for SQL Server 2012 • Fast Track for SQL Server 2008 R2 Effort to build Tuning Flexibility in configuration Initial Price Investment Low SW Low - Mid Mid HW Appliances deliver a solution with hardware and software already integrated, tested, tuned, configured Offerings • Parallel Data Warehouse • BDW, SDW • HP Factory Express Effort to build Tuning Flexibility in configuration Initial Price Investment Mid - High Low Low Low
    24. 24. Tuning & Optimization Procure or Use Existing HW & Support Installation Procure Software & Support Configuration Tuning & Optimization Installation Configuration TimetoSolution Installation Flexibility and Choice Offerings • SQL Server 2012 • SQL Server 2008 R2 Offerings • Fast Track for Server 2012 • Fast Track for SQL 2008 R2 Offerings • Parallel Data Warehouse • BDW, SDW • HP Factory Express Tuning & Optimization Procure or Use Existing HW & Support Procure Software & Support Procure Appliance & Support High Price High Optional if have HW already
    25. 25. Benefits SOFTWARE Self-build Data Warehouse with SQL Server 2012 - Bruce Kenny, Executive Vice President
    26. 26. Benefits REFERENCE ARCHITECTURES Guided-Build Data Warehouse with Fast Track Hasan Rahmi Atılganer, Data Process Manager Tom Grina, CFO
    27. 27. Benefits APPLIANCES Pre-Built Data Warehouse with Parallel Data Warehouse Peter van Manen, Managing Director
    28. 28. Benefits APPLIANCES Pre-Built Small Data Warehouse with BDW, SDW
    29. 29. “We anticipate huge data growth across all of our properties, and SQL Server Fast Track Data Warehouse gives us confidence that we can meet any scalability needs that arise.” - Jordan Zommick, Las Vegas Sands
    30. 30. Don Wood, Manager of Database Administration Jordan Zommick, Executive Director of Enterprise Architecture Fariba Anderson Vice President of Lottery IT - David Smith, Director, Software Architecture - Rajesh Babu, Sr Director Global BI -Matt Cunningham, ICT -Dale Danilewitz, Chief Information Officer -Mark Underwood, Second Vice President -Staffan Zackrisson, President and CEO
    31. 31. CASE STUDY- McLaren Electronic Systems McLaren Electronics Systems is part of the McLaren Group, a private group of companies that includes McLaren Racing. Store and analyze hundreds of billions of rows of data Analyze real-time racing conditions Peter van Manen, Managing Director
    32. 32. CASE STUDY- DirectEdge DirectEdge is the fourth largest US based exchange after NYSE, NADAQ, and BATs. It handles 10% of US trading. Test results met or exceeded projected needs for scale Power users can explore PDW directly Finance analysts can compare customer trading activities themselves
    33. 33. CASE STUDY- Volvo Aero Volvo Aero, a subsidiary of AB Volvo, develops and manufactures high-technology components for aircraft, rocket, and gas turbine engines. Rely on identical data across all stages of product design, development, and production. Easily and quickly disseminate order and product changes and updates. Increase user satisfaction. -Staffan Zackrisson, President and CEO, Volvo Aero
    34. 34. CASE STUDY- Protective The Protective Life Corporation offers insurance and investment products throughout the United States and Canada. Migrate from Teradata system End users perform own analysis without IT Increased processing speed by 15% Reduced IT administrative and maintenance costs of $600,000 over two years “By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.” - Mark Underwood, Second Vice President, Protective Life Corporation
    35. 35. CASE STUDY- Universal Music Group Universal Music Group is the world’s leading recording company. A subsidiary of Vivendi, UMG earned €4.4 billion (U.S.$6.1 billion) in revenue in 2010. Cuts cost by more than 97% and increase flexibility Renders reports 92% faster Delivers 100% uptime “Our IBM DB2 solution was very expensive in terms of hardware and software licensing costs. We just added 13 terabytes of capacity to our SQL Server Fast Track Data Warehouse at a minimal cost and we can also add memory for much less money than we could with our previous solution.” - Rajesh Babu, Sr Director Global BI “In the last 18 months, our SQL Server Fast Track Data Warehouse has delivered 100 percent uptime. We have not even had one serious memory alert.” - Rajesh Babu, Sr Director Global BI
    36. 36. CASE STUDY- Stein Mart Stein Mart is a growing department store chain that offers discounted fashion merchandise for men and women Save $600,000 a year in technology costs Improve Analysis and Forecasting Speed Reporting Process “With SQL Server Fast Track Data Warehouse, we can look at our entire transaction history and do market analysis and business forecasting, which we could not do previously. Now, for example, we will be able to study the correlation between promotions and sales.” Ilan Wajsman, Data Systems Manager “We will be able to eliminate 95 percent of the monthly costs related to the previous system,” says Wajsman.” Ilan Wajsman, Data Systems Manager
    37. 37. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.