NYC Data Amp - Microsoft Azure and Data Services Overview
•Download as PPTX, PDF•
2 likes•1,153 views
This is a presentation that covered an overview of Microsoft's AI, machine learning, and data services available in Azure.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to NYC Data Amp - Microsoft Azure and Data Services Overview
Similar to NYC Data Amp - Microsoft Azure and Data Services Overview (20)
More from Travis Wright
More from Travis Wright (16)
Recently uploaded
Recently uploaded (20)
NYC Data Amp - Microsoft Azure and Data Services Overview
- 2. How do you differentiate in the crowded casual dining market? $3TAnnual worldwide consumer food service revenue
- 4. Where guests click She’d like another glass of wine Make a suggestion for a good pasta pairing Delight her Receive her praise on social media Ziosk uses big data and table-side tablets to delight diners Capture guest data Predict preferences Deliver customized experiences in real-time Increase customer satisfaction Encourage return and advocacy
- 5. Tableside data also powers a real-time manager dashboard Sped average table turnover by 7 min • Reassign servers to relieve back-ups • Respond to guest dissatisfaction before they leave the dining room • Integrate with loyalty programs • Automatically send reports to corporate
- 6. Explore new business opportunities with data-driven services Improve visibility to make more accurate predictions with remote monitoring Get the right products to the right places with inventory management Offer customers exactly what they want, when they want it, with personalization Fix problems proactively before they start with predictive maintenance Integrate historic, real-time and predictive insights within your apps
- 7. Instantaneous response times Robust and scalable security Intelligence built-in Flexibility for changes in demand Powerful analytics Intuitive visualization tools
- 8. Cloud- powered Enjoy the scale, flexibility and affordability of the cloud Layered with security Secure your data and apps with built-in tools Integrated development Leverage open, flexible and extensible cross- platform DevOps tools Built for intelligence Drive decisions with predictive intelligence
- 9. STEP 1 Aggregate data STEP 2 Detect patterns STEP 3 Predict outcomes STEP 4 Automate decisions
- 10. Always encrypted Row level security Threat detection DATA ISOLATION Azure Active Directory Report generation
- 11. Any data Scale to petabytes Run apps anywhereCross-platform
- 12. DEVELOPER SERVICES APPLICATION SERVICES .NET JAVASCRIPT PHPNODE.JS C++PYTHON R CORDOVA UNITY Robust development platform for any app Visual Studio Azure SDK Team Project Application Insights Visual Studio + Xamarin Web Apps Mobile Apps API Apps API Management Logic Apps Notification Hubs
- 13. Watch Video
- 14. Filtering the signal from the noise Rolls-Royce “Our goal is not data for the sake of data, but to embrace the cloud and analytical technologies to deliver more expert insights to the right stakeholders at the right time.“ Nick Farrant Senior Vice President ROLLS-ROYCE Objectives Connect Rolls-Royce jet engine data to Microsoft's intelligent cloud for insights to improve aircraft performance, safety and maintenance. Tactics Use Cortana Intelligence to scale quickly and efficiently, aggregate data across customer fleets and process data in real time. Results • More efficient flight and maintenance plans • Targeted and actionable fuel efficiency insights • Quickly-generated reports and dashboards that tell compelling stories and deliver high-quality insights
- 15. Data Factory Files Query Events Push/ Pull Data Ingestion Data Storage Azure Storage DocumentDB HDInsight App Service Power BI Operations Engineering Pilots Weather data Maintenance data Flight Plan data Airplane data Data Visualization Machine Learning HDInsight Data Analysis Security / Identity Azure Key Vault Azure AD MFA Data Analyst Data Scientist Azure SQL Operations / Monitoring App Insights Azure Search Logic App Batch Security Center Governance Data Catalog SQL Data Warehouse Example: Data and Service Architecture Files Query Events Push/ Pull Data Ingestion 0 Data Storage Operations Engineering Pilots Weather data Maintenance data Flight Plan data Airplane data Data Visualization Data Analysis Security / Identity Digital Collaboration Platform Instance Data Analyst Data Scientist Operations / Monitoring Processing Step 1 CopyFormatSummarise Processing Step n Machine Learning Published Data Enriched Data Raw Data Dashboards Reports Analytics Models RBACDevOps Metadata Governance
- 16. Business intelligence Advanced analytics Any language, any platform, anywhere Security Structured Unstructured OLTP CRM ERP LOB Graph Social IoT Media Datavirtualization Dataintegration Big data processing Data warehousing Operational data Dashboards Reporting Mobile BI Cubes Predictive Analytics Machine learning Stream analytics Cognitive AI DATA SOURCES DATA INSIGHTSDATA STORAGE AND PROCESSING DEVELOPMENT CONSUMPTION Build powerful big data analytics apps with a comprehensive platform App services Dev services App health Data visualization Developers Customers Sellers Warehouse managers
- 17. Business intelligence Advanced analytics Structured Unstructured OLTP CRM ERP LOB Graph Social IoT Media Datavirtualization Dataintegration Big data processing Data warehousing Operational data DATA SOURCES DATA INSIGHTSDATA STORAGE AND PROCESSING DEVELOPMENT CONSUMPTION Build powerful big data analytics apps with a comprehensive platform Azure SQL Data Warehouse Azure Data Lake Azure Machine Learning Azure Stream Analytics Power BI Embedded Visual Studio Enterprise Visual Studio Team Services Cognitive Services Azure Analysis ServicesHDInsight Xamarin Developers Customers Sellers Warehouse managers Any language, any platform, anywhere Security: least vulnerable for the last 7 years 0 50 100 150 200 SQL Server MySQL Oracle IBM DB2 PostgreSQL SAP HANA Vulnerabilities (2010-2016) .NET Azure 3rd
- 18. Hyper-scale repository for big data analytics LOB Apps SocialDevices Clickstream Sensors Video Web Relational ADL Store Big Data Stores Data Lake Store SQL Data Warehouse ADL Analytics HDInsight R Spark Machine Learning • A Hadoop Distributed File System for the cloud • No fixed limits on file size • No fixed limits on account size • Unstructured and structured data in their native format • Massive throughput to increase analytic performance • High durability, availability, and reliability • Azure Active Directory access control
- 19. Power BI App Service SQL Database SQL Data Warehouse Machine Learning Hadoop Intelligent App Big Data Stores Data Lake Store SQL Data Warehouse • Petabyte scale with massively parallel processing • Independent scaling of compute and storage—in seconds • Transact-SQL queries across relational and non-relational data • Full enterprise-class SQL Server experience • Works seamlessly with Power BI, Machine Learning, HDInsight, and Data Factory Elastic data warehouse with enterprise-class features
- 20. Machine Learning and Analytics Predictive analytics solutions with easy deployment HDInsight (Hadoop and Spark) Stream Analytics Data Lake Analytics Machine Learning • Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions. • Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source. • Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.
- 21. Machine Learning and Analytics HDInsight (Hadoop and Spark) Stream Analytics Data Lake Analytics Machine Learning SQL Data Warehouse SQL DB Storage BlobsData Lake Store SQL DB in a VM • Analyze data of any kind and size • Develop faster, debug and optimize smarter • Interactively explore patterns in your data • No learning curve—use U-SQL, Spark, Hive, HBase and Storm • Managed and supported with an enterprise-grade SLA • Dynamically scales to match your business priorities • Enterprise-grade security with Azure Active Directory • Built on YARN, designed for the cloud Big data analytics for every data source Data Lake Analytics
- 22. Core Engine Batch Map Reduce Script Pig SQL Hive NoSQL HBase Streaming Storm In-Memory Spark Machine Learning and Analytics HDInsight (Hadoop and Spark) Data Lake Analytics Machine Learning • Scale to petabytes on demand • Process unstructured and semi-structured data • Develop in Java, .NET, and more • Skip buying and maintaining hardware • Deploy in Windows or Linux • Spin up an Apache Hadoop cluster in minutes • Visualize your Hadoop data in Excel • Easily integrate on-premises Hadoop clusters Operational data suite powered by Apache Stream Analytics
- 23. Machine Learning and Analytics HDInsight (Hadoop and Spark) Stream Analytics Data Lake Analytics Machine Learning • Scale to petabytes on demand • Process unstructured and semi-structured data • Develop in Java, .NET, and more • Skip buying and maintaining hardware • Deploy in Windows or Linux • Spin up an Apache Hadoop cluster in minutes • Visualize your Hadoop data in Excel • Easily integrate on-premises Hadoop clusters Real-time stream processing in the cloud Event Hubs Blob Storage Stream Analytics SQL Database Blob Storage Event Hubs Table Storage Power BI
- 24. Smart applications built to understand people Machine Learning & Analytics • Faces, images, emotion recognition and video intelligence • Spoken language processing, speaker recognition, custom speech recognition • Natural language processing, sentiment and topics analysis, spelling errors • Complex tasks processing, knowledge exploration, intelligent recommendations • Bing engine capabilities for Web, Autosuggest, Image, Video and News Cortana Bot Framework Cognitive Services Language Understanding Intelligent Service Bing Auto Suggest API Speaker Recognition Speech CRIS Text Analytics Bing Speller Web Language Model Linguistic Analysis Academic Knowledge Entity Linking Service Knowledge Exploration Service Recommendations Bing Search API Bing Image Search API Bing Video Search API Bing News Search API Computer Vision Face Emotion Video
- 25. Intelligent agents to interact with users Machine Learning & Analytics • Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter, and more. • Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot • Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences Cortana Bot Framework Cognitive Services
- 26. Demo Building a Bot in 5 seconds
- 27. Machine Learning Event HubsStream Analytics HDInsight Storage SQL Database Live dashboards for interactive business intelligence Dashboards & Visualizations • Analytics for everyone, even non-data experts • Your whole business on one dashboard • Create stunning, interactive reports • Drive consistent analysis across your organization • Embed visuals in your applications • Get real-time alerts when things change Power BI Power BI
- 28. Most consistent experience across on-premises and cloud Any data Any platform Any language Most secure database T-SQL Java PHP Node.js C/C++ C#/VB.NET Python Ruby
- 29. Redefining commerce through transparency Jet.com “To be one of the best e-commerce destinations in the US, we will have to handle millions of customers, placing tens of thousands of orders a day. That requires a top-class e-commerce system built on a flexible, open cloud platform. That is exactly what we got with Azure.” Mike Hanrahan Chief Technical Officer JET.COM Objectives Create a flexible, scalable data warehouse infrastructure with capabilities to handle an aggressive growth strategy. Tactics Adopted Microsoft SQL Data Warehouse and Azure HD Insight to handle vast amounts of data and streamline the development process. Results • Developed a full-fledged e- commerce marketplace in 12 months • Achieved rapid and flexible scalability enterprise-wide.
- 30. Using data to help save lives in the fight against pediatric AIDS Elizabeth Glaser Pediatric AIDS Foundation “Every day we make life-and-death decisions, so we can’t go on gut feelings or opinions. The data is the most important thing we have. Using Microsoft BI and analytics tools helps us make better decisions and save more children’s lives.” Stephanie Bruno Data Architecture Manager – Informatics ELIZABETH GLASER PEDIATRIC AIDS FOUNDATION Objectives Create a robust solution to accelerate the slow, inefficient collection of vital health information across at-risk populations and provide actionable intelligence from the data. Tactics Used SQL Server Reporting Services and Power BI to build a standardized set of reports, capture and summarize data, and roll it up to centralized reporting. Results • Easily accessible reports that helped communicate with donors and partners • Increased data reliability and accuracy • Improved data availability and reporting despite limited network capabilities
- 31. Moving from insight to action Rockwell Automation “What we’re talking about is delivering a degree of collaboration and visibility unheard of in the oil and gas industry. With sensors, software and the cloud, these disparate assets can become part of a connected enterprise, powered at its core by a rich flow of data.” Doug Weber Business Manager, Remote Application Monitoring ROCKWELL AUTOMATION Objectives Support high volume data to improve production efficiency, drive better performance and enable rapid innovation and go to market. Tactics Used Microsoft Azure SQL Database and HD Insight to collect sensor data from remote equipment across global supply chains and support real-time insight, analytics and predictive maintenance. Results • Improved access to production and supply chain data worldwide • Supported accelerated business growth with a highly scalable cloud platform • Utilized new features to get to market faster and make development easier
- 32. Assess with a partner-led data estate assessment Test with a partner-led proof of concept Get started today Learn and Experiment using self-service templates and training
- 33. Harnessing an ocean of data Carnival Maritime Objectives Improve visibility and gain deeper insight into their business operations by centralizing data management for thousands of devices and sensors across a fleet of 26 cruise ships sailing all over the world . Tactics Implemented Azure SQL Data Warehouse to leverage data captured by existing industrial hardware, and utilized the big-data platform to improve operations by analyzing historical data with custom models. Results • Connected thousands of devices and sensors into a centralized data repository • Created a scalable platform to extend, monitor and improve equipment maintenance across the fleet • Used predictive analytics to optimize water consumption, saving an estimated $200,000 a year “To build a big data and analytics strategy, our company needs to better understand what kind of data we can collect on the ships and what kind of data we need to have in the future…we want to use the data to get a better understanding of our operations and to help our ships be more efficient and sustainable.” Alexander Klingelhoefer Director of Continuous Improvement CARNIVAL MARITIME
- 34. Appendix
- 35. Data management • Azure Data Lake • Azure SQL Data Warehouse • Azure HDInsight Analytics • Azure Machine Learning • Azure Stream Analytics Development • Visual Studio Enterprise • Visual Studio Team Services • Azure Application Insights • Power BI Embedded • Xamarin
- 36. • Specifically designed to work with multiple analytics frameworks • Seamlessly scales from a few KBs to several PBs • Data is never lost or unavailable—even under failures • Offers enterprise-grade security for even the most sensitive data DATA MANAGEMENT Azure Data Lake ADL Analytics Spark Azure Machine Learning HDInsight R Azure Data Lake Store LOB Applications Social Clickstream Sensors Video Web Relational Devices A cost-effective cloud repository for big data
- 37. True cloud elasticity for freedom with control • Fully managed, Petabyte scale • Provision in minutes, scale in seconds • Query across relational and non-relational data with PolyBase • True cloud savings, with independent scaling of compute and storage, as well as pause & resume feature • Unmatched innovations in security with Threat Detection • Industry leading SLA – guaranteeing 99.9% uptime in GA regions • Availability in more regions than any other cloud data warehouse provider DATA MANAGEMENT Azure SQL Data Warehouse INGEST INSIGHT STORE A data warehouse that grows with your needs
- 38. Optimized open source analytics clusters • Fully managed Hadoop and Spark for the cloud • Enterprise-grade security and monitoring • Easy to manage, clusters up and running in minutes • Reliable with the industry’s best enterprise SLA • Familiar BI tools for analysis, or open source notebooks for interactive data science • Cost-effective cloud scale • 63% lower total cost of ownership than deploying your own Hadoop on-premises* • The most comprehensive protection against intellectual property risks with Azure IP Advantage *IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight” DATA MANAGEMENT Azure HDInsight
- 39. Powerful cloud-based predictive analytics • Easily build, deploy, and share predictive analytics solutions • Hundreds of built-in packages and support for custom code • Interactive, visual workspace – no programming required • Unlimited extensibility and one-click operationalization Collect & manage data Create machine learning models ML STUDIO SAAS APP MACHINE LEARNING SERVICE Run regular algorithms through connected database WEB SERVICE Add intelligence to app or provide insights in BI tools BI VISUALIZATIONS ANALYTICS Azure Machine Learning
- 40. Intelligence to enhance the user experience • Add smart API capabilities to enable contextual interactions • Tap into powerful AI algorithms for vision, speech, language, knowledge, and search • Allow your apps to apt to what users want and learn from your data • Map complex data to provide intelligent cross-sell recommendations Improved customization and engagement SaaS app ANALYTICS Microsoft Cognitive Services
- 41. Converge digital and physical worlds • Use pre-configured solutions such as Remote Monitoring and Predictive Maintenance to accelerate your IoT projects and jump ahead of the competition • Connect a broad range of existing device types and harness disparate data to create new intelligence • Predict with advanced analytics and machine learning to capture previously impossible insights • Tailor IoT solutions to your company’s business needs to quickly move from proof of concept to broader deployments • Integrate Azure IoT Suite with existing systems to make the best use of the data and processes you already have ANALYTICS Azure IoT Suite
- 42. Share code, track work, and ship software—in any language DEVELOPMENT Visual Studio Team Services • Secure code management to effectively create, manage and deliver against your backlog • Unparalleled flexibility for evolving codebases • Code is linked directly to the story, bug, or task • A toolset optimized for QA professionals, providing work style flexibility and team collaboration • Build apps with any tools and languages across multiple platforms • Streamline and automate the workflow between development and IT Ops to deliver higher quality SW more frequently • Customize and extend the Visual Studio platform to create the perfect dev environment
- 43. An integrated, end-to-end DevOps solution • Greater productivity for enterprise application development & delivery • Create mobile business applications for Android, iOS and Windows • Manage complexity and close the loop between Development & IT Ops • Plan, execute & monitor your entire testing effort • Full support across the DevOps lifecycle DEVELOPMENT Visual Studio Enterprise iOS Android Windows Visual Studio Enterprise Data Analyst Developer ITDM BDM .NET JAVASCRIPT PHPNODE.JS C++PYTHON R CORDOVA UNITY
- 44. Interactive data visualization and compelling reports • Author interactive data reports without writing any code using Power BI Desktop • Choose modern data visualizations out-of-the-box or customize without from scratch • Embed interactive visuals in your app using REST APIs and the Power BI SDK • Use your existing authentication and authorization methods • Speed up time to value without redesigning your existing app • Pay only for what you use with no upfront costs DEVELOPMENT Power BI Embedded
- 45. Create amazing cloud-powered mobile apps faster • Scale your apps to millions of customers across multiple geographies • Quickly add authentication, push notifications, and offline data sync • Connect your apps to enterprise systems, in the cloud or on premises • Use infinitely scalable storage to manage app resources • Build powerful apps with integrated tools, cloud services, and mobile SDKs • Integrate your mobile DevOps processes and systems with a few lines of code DEVELOPMENT Xamarin
- 46. Sign up for a free trial of Microsoft Azure https://azure.microsoft.com/en-us/free/
- 47. Cutting energy costs through machine learning Carnegie Mellon University Objectives Resolve complex big data challenges across fields as diverse as astrophysics and building management. Tactics Used Azure Machine Learning to address the challenge of fault detection and diagnosis for control-system components hidden from visual inspection. Results • Realized estimated energy savings of 20 percent • Simplified and accelerated the time-consuming process of creating and testing machine learning models “We see Azure Machine Learning ushering in an era of self-service predictive analytics for the masses. We can only imagine the possibilities.” Bertrand Lasternas Researcher CARNEGIE MELLON UNIVERSITY
- 48. Creating a crystal ball for appliance manufacturing Arçelik A.Ş. Objectives Replace an outdated forecasting system with a new solution to improve accuracy and ensure the right spare parts are available anytime and anywhere they’re needed. Tactics Used Azure Machine Learning to test algorithms and identify the most accurate ones to forecast the needs for spare parts 12 months in advance. Results • Forecasting accuracy increased up to 80% • Inventory turnover expected to climb by 10% • Increased forecasts from 100,000 to all 350,000 spare parts SKUs “With more spare parts in our warehouse, we needed a way to respond to customer needs quickly. We reached that goal by using Azure Machine Learning to increase forecast accuracy.” Burcu Aksoy, Spare Part Team Leader, Customer Care ARCELIK
- 49. Filtering the signal from the noise Rolls-Royce “Our goal is not data for the sake of data, but to embrace the cloud and analytical technologies to deliver more expert insights to the right stakeholders at the right time.“ Nick Farrant Senior Vice President ROLLS-ROYCE Objectives Connect Rolls-Royce jet engine data to Microsoft's intelligent cloud for insights to improve aircraft performance, safety and maintenance. Tactics Use Cortana Intelligence and Azure Machine Learning to scale quickly and efficiently, aggregate data across customer fleets and process data in real time. Results • More efficient flight and maintenance plans • Targeted and actionable fuel efficiency insights • Quickly-generated reports and dashboards that tell compelling stories and deliver high-quality insights
- 50. Business intelligence turns customers into fans Metro Bank “As we grew, we needed something more dynamic, more visually appealing and more user-friendly…Power BI fits the bill in all of those respects.” Bruce Rioch Head of Business Information and Customer Systems METRO BANK Objectives Innovate customer service by capturing data that is clear and easy to understand, and available to the right person at the right time. Tactics Used Power BI to gather deeper and more detailed information about what customers wants and needs to guide analysis and decision-making. Results • Continuous improvement in customer experience • Expanded offerings built on new capabilities • At-a-glance visualizations of how customers interact with bank services
- 51. Using data to help save lives in the fight against pediatric AIDS Elizabeth Glaser Pediatric AIDS Foundation “Every day we make life-and-death decisions, so we can’t go on gut feelings or opinions. The data is the most important thing we have. Using Microsoft BI and analytics tools helps us make better decisions and save more children’s lives.” Stephanie Bruno Data Architecture Manager – Informatics ELIZABETH GLASER PEDIATRIC AIDS FOUNDATION Objectives Create a robust solution to accelerate the slow, inefficient collection of vital health information across at-risk populations and provide actionable intelligence from the data. Tactics Used SQL Server Reporting Services and Power BI to build a standardized set of reports, capture and summarize data, and roll it up to centralized reporting. Results • Easily accessible reports that helped communicate with donors and partners • Increased data reliability and accuracy • Improved data availability and reporting despite limited network capabilities
- 52. Redefining commerce through transparency Jet.com “To be one of the best e-commerce destinations in the US, we will have to handle millions of customers, placing tens of thousands of orders a day. That requires a top-class e-commerce system built on a flexible, open cloud platform. That is exactly what we got with Azure.” Mike Hanrahan Chief Technical Officer JET.COM Objectives Create a flexible, scalable data warehouse infrastructure with capabilities to handle an aggressive growth strategy. Tactics Adopted Microsoft SQL Data Warehouse and Azure HD Insight to handle vast amounts of data and streamline the development process. Results • Developed a full-fledged e- commerce marketplace in 12 months • Achieved rapid and flexible scalability enterprise-wide.
- 53. Moving from insight to action Rockwell Automation “What we’re talking about is delivering a degree of collaboration and visibility unheard of in the oil and gas industry. With sensors, software and the cloud, these disparate assets can become part of a connected enterprise, powered at its core by a rich flow of data.” Doug Weber Business Manager, Remote Application Monitoring ROCKWELL AUTOMATION Objectives Support high volume data to improve production efficiency, drive better performance and enable rapid innovation and go to market. Tactics Used Microsoft Azure SQL Database and HD Insight to collect sensor data from remote equipment across global supply chains and support real-time insight, analytics and predictive maintenance. Results • Improved access to production and supply chain data worldwide • Supported accelerated business growth with a highly scalable cloud platform • Utilized new features to get to market faster and make development easier
Editor's Notes
- It’s big news: BIG data reveals BIG insights which lead to BIG bucks. Which begs the question, what, specifically, are you doing to make the most of all the new data sources? Many businesses want to use big data but their IT teams struggle with how to make it comprehensible and cost effective – largely because, up until, now it has been neither. Today, we’re going to illustrate how you can bring big data analytics to your teams through smart apps that revolutionize the way they work. Starting with a single app, you can pivot your role in the company – from the team that takes care of computers to the team that makes dreams come true.
- Take for example the casual dining market. It’s flooded with tens of thousands of competing restaurants such as TGIFridays, Olive Garden, Cheesecake Factory... All of whom are fighting for a piece of the $3 trillion pie. How do they stand out to their customers? How do they make their somewhat generic experience favorable enough to win more business? Source: https://www.firstresearch.com/Industry-Research/Casual-Restaurants.html
- Enter Ziosk: the maker of the world’s first ordering, entertainment, and pay-at-the-table tablet. Ziosk’s tablets began as a way to help restaurants improve customer service and satisfaction by offering self-service capabilities and a direct line of communication to the staff – as well as personal entertainment. Today, using the wealth of big data the tablets accumulate from individuals’ interactions, Ziosk runs predictive analytics applications to help restaurants know their customers’ preferences and tailor each customer’s experience on the fly. Ziosk tablets make the causal dining experience more convenient, more engaging and now more personal for customers.
- On the flip side, the data Ziosk collects and analyzes can be piped into restaurant managers as a real-time dashboard that allows them to quickly understand what’s happening on the floor at any minute. With this information, they can adjust staff and resources, coach employees through challenging situations, and head off negative experiences before they arise.
- Of course, optimizing the restaurant experience isn’t the limit of what can be done with big data, it’s inspiration for what YOU can do with big data. From inventory management to customer service to financial market positioning and more, big data analytics applications can improve nearly every aspect of your business by making it easier for teams to make smart, fast and efficient decisions. Remote monitoring improves visibility of assets to help you make more accurate predictions. Inventory management ensures you get the right products to the right places. Personalized profiles enable you to offer customers exactly what they want, when they want it. Predictive maintenance allows you to fix problems proactively before they start. And data-driven services help you explore new business opportunities. A big data analytics app integrates all varieties and sources of data into a focused and easy-to-understand UI tailored for the needs of a particular audience. It puts the past, present and future in the hands of the app user, to enable her to quickly and easily understand the many facets of her business, their interconnectedness and her points of influence.
- Of course, building a big data analytics application that is as powerful as it is useful requires a serious toolkit. You have to be able to ensure: Instantaneous response times with up-to-date information Robust and scalable security that covers your users from any device and any location without compromising your data, customers or employees Intelligence built-in to the database that runs as close to the data source as possible Flexibility for changes in demand that keeps the app running even when usage spikes Powerful analytics to make simple work of serious problems, and Intuitive visualization tools that bring data to life and respond to explorative probing It’s a daunting list of requirements to fill, especially if you have to cobble together different vendors and solutions.
- With Microsoft, you get everything you need built to work together in a flexible and affordable cloud environment. Whether you work exclusively in Microsoft, or supplement your existing assets with Microsoft cloud services and solutions, we can help you create a robust, cohesive and secure application that delivers the latest in big data analytics. The Microsoft solution for big data analytics is: built for intelligence, layered with security, powered by the cloud and integrated with development tools. Let’s take a closer look at what each of those mean.
- Built for intelligence: Your apps are only as useful as they are intelligent. You can’t make breakthrough business decisions if you don’t have breakthrough insights. The Microsoft environment facilitates the process that turns data into intelligence – aggregating diverse data sources, detecting complicated patterns, predicting likely outcomes, automating decisions – by building in technology that streamlines each stage and connects to the next. Other vendors offer partial or unconnected assets that make each of these steps tedious and sometimes incompatible. When you build your app with Microsoft, data flows into decisions. Built-in intelligence, in the form of predictive analytics, machine learning and interactive visualizations, strips away layers of manual analysis and IT obstacles to get you to the business opportunity faster.
- Layered with security: Security is paramount no matter who you are or what you do. Your reputation hinges on data control and privacy which means our reputation hinges on it too. Big data applications pose unique security challenges in that they incorporate diverse and oftentimes unsecured data sources, rely on cloud-based engines to run, and are typically accessed from personal devices across the globe. We understand the risk and exposure you face with every click and transaction which is why we constantly invest in innovative measures to keep you in control of your data. The layers of security built into the Microsoft environment make it easy for you to use data and administer resources without forcing you to make trade offs in security. Most recently we’ve added advanced capabilities such as Always Encrypted, Row level security, dynamic data masking to the database layer to keep data secure at the source. In the operating system, we’ve created robust authentication and threat detection tools to help you monitor users and control access. And in case of an unforeseen event or disaster, our high availability and disaster recovery solutions guarantee to keep you running - business as usual. With Microsoft, you can rest assured we’re constantly going above and beyond to give you full and exclusive control of your data so it’s as safe as you need it to be.
- Cloud powered: For most companies, big data analytics wouldn’t be possible without the cloud. From managing massive amounts of all types of data, to providing data access anywhere in the world on any device - your analytics app needs the scale, flexibility, affordability and access only the cloud can offer. Microsoft’s cloud-first commitment means that new technology is launched, tested and perfected in the cloud FIRST, so you can be sure the technology you need lives there already and has been fully proven.
- Integrated development: Only Microsoft enables an open, flexible and extensible cross-platform experience for building applications. Rich with DevOps tools that support any developer of any app, the Visual Studio and Xamarin environment empower innovative collaboration across teams to support continuous and rapid development. Best of all, you can easily move the data and app layers between Azure and on-premises databases and take advantage of the best of both worlds for your production and development needs.
- Video: https://www.youtube.com/watch?v=B3CZXp-RK0g Rolls Royce: from selling engine to hours: cannot ever fail. Use sensors data =>CIS http://rolls-royce.azurewebsites.net/#/fleetlocation
- http://enterprise.microsoft.com/en-us/industries/discrete-manufacturing/rolls-royce-and-microsoft-collaborate-to-create-new-digital-capabilities-2/ – Microsoft Customer Story Flight delays are a familiar headache for most people who fly on commercial airlines. At a personal level, they are disruptive and costly, but for the airlines the impact is exponentially larger. Minimizing the cost and disruption of maintenance activities is a key focus for these businesses. Rolls-Royce has more than 13,000 engines for commercial aircraft in service around the world, and for the past 20 years, it has offered customers comprehensive engine maintenance services that help keep aircraft available and efficient. As the rapidly increasing volume of data coming from many different types of aircraft equipment overtakes the airlines’ ability to analyze and gain insight from it, Rolls-Royce is using the Microsoft Azure platform to fundamentally transform how it uses data to better serve its customers. Worldwide, flight delays and disruptions cost the airline industry millions of dollars every year. Even a small reduction in “aircraft on ground” (AOG) time can translate into significant amount of money, so airlines are always looking for ways to improve the efficiency of maintenance activities. To bring its vision of a powerful and scalable data analytics system to life, Rolls-Royce chose to build it on the Microsoft Azure platform. Starting with Azure IoT Suite, Rolls-Royce will be able to collect and aggregate data from disparate and geographically distributed sources at an unprecedented scale. Initially, the types of data being processed include snapshots of engine performance that the planes send wirelessly during a flight, massive downloads of comprehensive “black box”–type data, technical logs, and flight plans as well as forecast and actual weather data provided by third parties. Using Microsoft Cortana Intelligence Suite, Rolls-Royce will be able to analyze a rich set of data and perform data modeling at scale to accurately detect operational anomalies and help customers plan relevant actions. In expanding the scope of services Rolls-Royce offers its customers, fuel efficiency is one of the first and highest-yield areas that the company is targeting. By analyzing new data against existing forecasts, reference tables, and historical trends, Rolls-Royce will be able to help airlines understand exactly which factors—including flight plans, equipment maintenance, weather, and discretionary fuel—have the most impact on fuel performance. All of this requires a massive level of scalability that is greatly facilitated by employing a wide range of Azure platform services. From using Azure Data Factory for orchestration and Azure HDInsight for high-level data aggregation and summarization, to using Azure SQL and Azure Blob Storage to handle all the different types of storage needs, Rolls-Royce is taking full advantage of the integrated Azure platform services. According to the PwC Global Airline CEO Survey 2014, 71 percent of airline CEOs reported that they are developing future strategies or have concrete plans for making changes to their data management and data analytics. With highly scalable and sophisticated data analytics services built on the Azure platform, Rolls-Royce’s plan to use data to improve the reliability and efficiency of air travel has already taken off.
- Talk track aroun the problems that the data estate can address Modern Data Warehousing lays the foundation for integrating any data using any language for both on-prem & cloud. This platform can ingest both relational and non-relational data, and through data virtualization it can process and manage with Data Warehousing and Big data processing. BI tools and Advanced Analytics drive insights and visualize them for your organization. We’ll now show the Microsoft Modern Data Warehouse solution.
- Talk track aroun the problems that the data estate can address Modern Data Warehousing lays the foundation for integrating any data using any language for both on-prem & cloud. This platform can ingest both relational and non-relational data, and through data virtualization it can process and manage with Data Warehousing and Big data processing. BI tools and Advanced Analytics drive insights and visualize them for your organization. We’ll now show the Microsoft Modern Data Warehouse solution.
- Your data are valuable assets to your organization and have both present and future value. Because of this, all data should be stored for future analysis. Today this is often not done because of the restrictions of traditional analytics infrastructure, like the pre-definition of schemas, the cost of storing large datasets, and the propagation of different data silos. To address this challenge, the data lake concept was introduced as an enterprise-wide repository to store every type of data collected in a single place. For the purpose of operational and exploratory analytics, data of all types can be stored in a data lake prior to defining requirements or schema. Microsoft Azure Data Lake Store is a Hadoop file system that’s compatible with Hadoop Distributed File System (HDFS) and works with the Hadoop ecosystem. Data Lake Store is integrated with Azure Data Lake Analytics and Azure HDInsight and will be integrated with Microsoft offerings like Revolution-R Enterprise; industry-standard distributions like Hortonworks, Cloudera, and MapR; and individual Hadoop projects like Spark, Storm, Flume, Sqoop, and Kafka. Data Lake Store is a very open, massive scale data store designed for extremely high throughput and low latency for analytics workloads. At the same time, its built-in security ensures you can include even your most critical workloads on it. T: You may have noticed we are emphasizing these services are all built to scale, and SQL Data Warehouse is no different.
- Historically, data warehouses have required fixed combinations of storage and compute, often underutilizing expensive resources. With Azure SQL Data Warehouse, storage and compute scale independently. You can dynamically deploy, grow, shrink, and even pause compute, taking advantage of best-in-class price/performance. Also, SQL Data Warehouse uses the power and familiarity of T-SQL to let you easily integrate query results across relational data in your data warehouse and non-relational data in Azure blob storage. SQL Data Warehouse uses Microsoft’s massively parallel processing (MPP) architecture. You pay for time-to-insight, not hardware, based on performance objectives for fundamental data warehousing operations like scanning, loading, and query processing. SQL Data Warehouse uses SQL Server in-memory columnstore indexes and an advanced cost-based query optimizer to deliver optimal price/performance. T: Next let’s look at Machine Learning and Analytics
- Azure Machine Learning is a fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions. You can deploy your model into production as a web service in minutes—a web service that can be called from any device, anywhere and that can use any data source. You can also Share your solution with the world in the Gallery or on the Azure Marketplace. We’ll get into more details about what Machine Learning can do in our demo later on. T: Next is Data Lake Analytics.
- Azure Data Lake Analytics is a new distributed service in the Azure Data Lake. We built Azure Data Lake Analytics from the ground up for cloud scale and performance. Data Lake Analytics makes the complex task of managing distributed infrastructure and complex code easy. It dynamically provisions resources and lets you do analytics on exabytes of data. When the job completes, it winds down resources automatically, and you pay only for the processing power used. As you increase or decrease the size of data stored or the amount of compute used, you don’t have to rewrite code. This lets you focus on your business logic only and not on how to process and store large datasets. It also takes away the complexities normally associated with big data in the cloud and ensures that Data Lake will meet your current and future business needs. Azure Data Lake is the only solution that uses U-SQL, A powerful new language that brings the best of SQL and C# together with open source capabilities like Hive or Spark. It is built for cloud scale and performance, it’s managed and it’s easy to set up. It seamlessly integrates with existing systems to make you productive from day one. T: Next, let’s discuss HDInsight.
- Azure HDInsight is an Apache Hadoop distribution powered by the cloud. This means that it handles any amount of data, scaling from terabytes to petabytes on demand. Spin up any number of nodes at any time. We charge only for the compute and storage that you use. Because it's 100 percent Apache Hadoop, HDInsight can process unstructured or semi-structured data from web clickstreams, social media, server logs, devices and sensors, and more. This lets you analyze new sets of data and uncover new business possibilities that drive your organization forward. HDInsight has powerful programming extensions for languages including C#, Java, and.NET. Use your programming language of choice on Hadoop to create, configure, submit, and monitor Hadoop jobs. With HDInsight, deploy Hadoop in the cloud without buying new hardware or incurring other up-front costs. There’s also no time-consuming installation or set up. Azure does it for you. Launch your first cluster in minutes. Because it's integrated with Excel, HDInsight lets you visualize and analyze your Hadoop data in compelling new ways using a tool that's familiar to your business users. From Excel, users can select HDInsight as a data source. HDInsight is also integrated with Hortonworks Data Platform, letting you move Hadoop data from an on-site datacenter to the Azure cloud for backup, Dev/Test, and cloud-bursting scenarios. Using the Microsoft Analytics Platform System, you can even query your on-premises and cloud-based Hadoop clusters at the same time. T: Next up is Azure Stream Analytics
- Azure Stream Analytics lets you rapidly develop and deploy low-cost solutions to gain real-time insights from streaming data from devices, sensors, infrastructure, and applications. Use it for Internet of Things (IoT) scenarios, such as real-time remote management and monitoring or gaining insights from devices like mobile phones and connected cars. With every device, service, and process becoming a data point, the problem can often be analyzing and acting on data fast enough. Stream Analytics is easy to deploy, and simple to develop for, a low cost end to end event stream processing solution, that scales on demand. Use fewer lines of code with built in analysis processes. Combine Stream Analytics with Event Hubs to analyze millions of points of data in a reliable environment. T: Next, we’ll take a look at a demo that illustrates the value of the intelligence capabilities that Cortana Intelligence offers.
- What’s incredibly unique is the intelligence capabilities Cortana Intelligence offers, building on years of Microsoft research and innovation. These capabilities enable our customers to build intelligent systems and agents that can augment their organizational capabilities. For example, organizations can interact with customers and stakeholders in new ways and infer intent with vision, face, speech, text and sentiment analysis to customize responses and drive appropriate actions. Microsoft Cognitive Services, a set of cloud services, APIs and SDKs that enable organizations to build intelligent systems that can see, hear, interpret and understand the world around you and makes all applications more intelligent, engaging and discoverable. Cognitive Services expands the existing perceptual intelligence capabilities like Vision, Speech, Text and Face detection to include new cognitive capabilities such as Emotion and customized Language Understanding. What we showcased with www.how-old.net is one example of what is possible. T: Next, Bot Frameworks.
- Microsoft Bot Framework enables organizations to build intelligent agents (Bots) that allow your intelligent systems to interact with your users in more contextual and natural ways, from text/sms to Office365 mail to Skype, Slack and other services. The Bot Framework provides developers with a developer portal & SDK to build your bot, a bot connector service to connect to social channels such as Twitter, Slack etc. and a bot directory to discover and use existing bots. T: Next, Cortana.
- https://qnamaker.ai/ https://gallery.cortanaintelligence.com/solutions
- Many of the services we’ve been talking about today are on the back-end. But your data and the results of analytics are only useful if they can be provided to those who need them – often people without deep data expertise. That’s where Power BI comes in. Power BI is a cloud-based dashboard and visualization service that provides faster time to insight. It is used for visualizing, exploring and extracting insights from data. It brings together data from diverse sources to deliver rich, comprehensive views of your business. With Power BI, you can see all of your data in one place and share reports. Live dashboards and reports show visualizations and KPIs from data that reside both on-premises and in the cloud, providing a consolidated view across your business regardless of where your data lives. T: Now that we’ve walked through everything, let’s take a look at the whole picture.
- Just imagine: any data, any language, on any platform on the most secure database in the industry. Microsoft’s comprehensive environment gives you the tools to create apps that turn data into decision and transform not only the way your teams do business, but the business opportunities they create.
- Source: https://www.microsoft.com/en-us/cloud-platform/customer-stories-rockwell-automation https://customers.microsoft.com/en-US/story/fueling-the-oil-and-gas-industry-with-iot-1 (Correct as of 11/11/16) Rockwell Automation, the world’s largest industrial automation and information firm, wanted to strengthen its competitive advantage and open new business opportunities in the oil and gas industry by automating the collection and analysis of data from remote installations across the petroleum supply chain. Rockwell worked with Microsoft to create a solution to monitor expensive capital assets and use that data to improve efficiency, drive better performance and enable innovation. Based on Azure IoT services, the solution collects, integrates and organizes sensor data from remote equipment across global supply chains to support real-time insight, predictive analytics and preventive maintenance. With this solution, Rockwell can now help alert customers to potential issues and failures and provide remote troubleshooting to reduce costly downtime. As Business Manager Doug Weber noted, “The ability to automate these transactions across thousands of machines and countless miles is transformational for this industry…Now all parties involved can have immediate electronic records of transactions, real accountability in these remote locations, immediate awareness for maintenance and diagnostics, and new levels of information about every transaction.” By working with Microsoft to automate the collection and analysis of data from remote installations across the petroleum supply chain, Rockwell Automation strengthened its competitive advantage and opened new business opportunities in the oil and gas industry. Relevant products: Azure Azure IoT Suite
- You can get started for free today through an estate assessment and proof of concept that brings the abstract to life. For the assessment, Microsoft provides a partner of your choosing to help you evaluate your current estate and create a roadmap that leads to your application goals. Using that information, a qualified partner will set up a test environment that meets your specific requirements. Big data is here to stay. Why not be the who brings it into your business?
- In summary, with Visual Studio Enterprise, .NET developers get the tools and services for all phases of the end-to-end DevOps lifecycle out of the box. For mobile developers, looking to meet the highest quality standards, VSE provides exclusive mobile-specific quality assurance tools that not only significantly speed up the developer inner loop but also enables effortless testing on thousands of real mobile devices, crash analytics, app distribution to beta testers, and user feedback collection. In a DevOps world where continuous testing is the new normal, Visual Studio Enterprise enables teams to plan, execute and monitor the entire testing effort continuously with a full range of integrated testing tools, including test management, exploratory testing, performance testing, automated UI testing, and more. .NET teams embracing DevOps at scale or in complex environments can now benefit from learnings that Microsoft has productized and put as features into VSE exclusively. VSE unlocks massive productivity and quality gains and provides a complete end-to-end DevOps solution. With VSE, .NET teams of any size can leverage advanced tools and services to design, build, deploy and manage complex solutions, modern applications and services for Android, iOS, Windows, web, cloud and desktop.
- http://enterprise.microsoft.com/en-us/industries/discrete-manufacturing/rolls-royce-and-microsoft-collaborate-to-create-new-digital-capabilities-2/ – Microsoft Customer Story Flight delays are a familiar headache for most people who fly on commercial airlines. At a personal level, they are disruptive and costly, but for the airlines the impact is exponentially larger. Minimizing the cost and disruption of maintenance activities is a key focus for these businesses. Rolls-Royce has more than 13,000 engines for commercial aircraft in service around the world, and for the past 20 years, it has offered customers comprehensive engine maintenance services that help keep aircraft available and efficient. As the rapidly increasing volume of data coming from many different types of aircraft equipment overtakes the airlines’ ability to analyze and gain insight from it, Rolls-Royce is using the Microsoft Azure platform to fundamentally transform how it uses data to better serve its customers. Worldwide, flight delays and disruptions cost the airline industry millions of dollars every year. Even a small reduction in “aircraft on ground” (AOG) time can translate into significant amount of money, so airlines are always looking for ways to improve the efficiency of maintenance activities. To bring its vision of a powerful and scalable data analytics system to life, Rolls-Royce chose to build it on the Microsoft Azure platform. Starting with Azure IoT Suite, Rolls-Royce will be able to collect and aggregate data from disparate and geographically distributed sources at an unprecedented scale. Initially, the types of data being processed include snapshots of engine performance that the planes send wirelessly during a flight, massive downloads of comprehensive “black box”–type data, technical logs, and flight plans as well as forecast and actual weather data provided by third parties. Using Microsoft Cortana Intelligence Suite, Rolls-Royce will be able to analyze a rich set of data and perform data modeling at scale to accurately detect operational anomalies and help customers plan relevant actions. In expanding the scope of services Rolls-Royce offers its customers, fuel efficiency is one of the first and highest-yield areas that the company is targeting. By analyzing new data against existing forecasts, reference tables, and historical trends, Rolls-Royce will be able to help airlines understand exactly which factors—including flight plans, equipment maintenance, weather, and discretionary fuel—have the most impact on fuel performance. All of this requires a massive level of scalability that is greatly facilitated by employing a wide range of Azure platform services. From using Azure Data Factory for orchestration and Azure HDInsight for high-level data aggregation and summarization, to using Azure SQL and Azure Blob Storage to handle all the different types of storage needs, Rolls-Royce is taking full advantage of the integrated Azure platform services. According to the PwC Global Airline CEO Survey 2014, 71 percent of airline CEOs reported that they are developing future strategies or have concrete plans for making changes to their data management and data analytics. With highly scalable and sophisticated data analytics services built on the Azure platform, Rolls-Royce’s plan to use data to improve the reliability and efficiency of air travel has already taken off.
- Source: https://www.microsoft.com/en-us/cloud-platform/customer-stories-rockwell-automation https://customers.microsoft.com/en-US/story/fueling-the-oil-and-gas-industry-with-iot-1 (Correct as of 11/11/16) Rockwell Automation, the world’s largest industrial automation and information firm, wanted to strengthen its competitive advantage and open new business opportunities in the oil and gas industry by automating the collection and analysis of data from remote installations across the petroleum supply chain. Rockwell worked with Microsoft to create a solution to monitor expensive capital assets and use that data to improve efficiency, drive better performance and enable innovation. Based on Azure IoT services, the solution collects, integrates and organizes sensor data from remote equipment across global supply chains to support real-time insight, predictive analytics and preventive maintenance. With this solution, Rockwell can now help alert customers to potential issues and failures and provide remote troubleshooting to reduce costly downtime. As Business Manager Doug Weber noted, “The ability to automate these transactions across thousands of machines and countless miles is transformational for this industry…Now all parties involved can have immediate electronic records of transactions, real accountability in these remote locations, immediate awareness for maintenance and diagnostics, and new levels of information about every transaction.” By working with Microsoft to automate the collection and analysis of data from remote installations across the petroleum supply chain, Rockwell Automation strengthened its competitive advantage and opened new business opportunities in the oil and gas industry. Relevant products: Azure Azure IoT Suite