Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Microsoft Technologies for Data Science 201612

654 views

Published on

Delivered to SQL Saturday BI Edition -- Atlanta, GA
Microsoft provides several technologies in and around Azure which can be used for casual to serious data science. This presentation provides an overview of the major Microsoft options for both on-premise and cloud-based data science (and hybrid). These technologies have been used by the presenter in various companies and industries, both as a Microsoft consultant and previously independent consultant. As well, the speaker provides insights into data science careers, information which helps imply where the business will likely be for consultants and partners.

Published in: Data & Analytics
  • Be the first to comment

Microsoft Technologies for Data Science 201612

  1. 1. Microsoft Technologies for Data Science Mark Tabladillo, Ph.D. Lead Data Scientist (Architect) Microsoft December 2016: SQL Saturday BI Atlanta, GA
  2. 2. Networking Interactive
  3. 3.     
  4. 4.          
  5. 5. Terms Definition Data Science Machine Learning Data Mining Applied Statistics the automated or semi- automated process of discovering patterns in data Applied scientific method
  6. 6. http://www.kdnuggets.com/2016/06/r-python-top-analytics-data-mining-data-science-software.html
  7. 7. https://azure.microsoft.com/en-us/documentation/learning-paths/data-science-process/
  8. 8. https://azure.microsoft.com/en-us/documentation/learning-paths/data-science-process/
  9. 9. https://azure.microsoft.com/en-us/documentation/learning-paths/data-science-process/
  10. 10.
  11. 11. Technology Choices SQL SERVER ANALYSIS SERVICES Enterprise Business Intelligence EXCEL ADD-IN FOR SSAS Office 365 Office 2013 or Higher x64 SEMANTIC SEARCH Enterprise Business Intelligence Standard Web Express with Advanced Services MICROSOFT AZURE ML Free (Size Limited) Paid (Web Service): Experiment + Query F# Open Source SQL SERVER R SERVICES SQL Server 2016 or higher
  12. 12. http://download.microsoft.com/download/F/C/2/FC21C981- 4351-4434-A78A- 3384CA7515BF/SQL_Server_2016_Deeper_Insights_Across_D ata_White_Paper.pdf
  13. 13. SS SQL AS NoSQL
  14. 14. Data mining add-in for business analysts • Ease of use • Rich data mining • Scalable
  15. 15. Rowset Output with Scores Varchar NVarchar Office PDF
  16. 16. Documents Full-Text Keyword Index “FTI” iFilters Semantic Document Similarity Index “DSI” Semantic Database Semantic Key Phrase Index – Tag Index “TI”
  17. 17. Simplified Chinese British English Portuguese Chinese (Hong Kong SAR, PRC) Spanish Chinese (Singapore) Chinese (Macau SAR)
  18. 18. Time in Seconds vs. Number of Documents (2011 – K. Mukerjee, T. Porter, S. Gherman – Microsoft) http://users.cis.fiu.edu/~lzhen001/activities/KDD2011Program/docs/p213.pdf
  19. 19. Features Microsoft R Open R Distribution (Free) Microsoft R Client Free Microsoft R Server Commercial Big Data In-memory bound Can only process datasets that fit into the available memory In-memory bound Can process datasets that fit into the available memory Operates on large volumes when connected to R Server Disk scalability Operates on bigger volumes & factors Speed of Analysis Multi-threaded when MKL is installed for non-ScaleR functions Multi-threaded with MKL for non-ScaleR functions Up to 2 threads for ScaleR functions with a local compute context Full parallel threading & processing Enterprise Readiness Community support Community support Commercial support Analytic Breadth & Depth 8000+ open source packages Leverage & optimize open source R packages plus 'Big Data'-ready ScaleR packages Leverage & optimize open source R packages plus 'Big Data'-ready + Multithreaded ready ScaleR packages Commercial Viability Risk of deployment to open source Free for everyone Commercial licenses DeployR Enterprise Not available Not available Included
  20. 20. Microsoft R Server Editions Description Install ScaleR Get Started R Server for Hadoop Scale your analysis transparently by distributing work across nodes without complex programming Doc Doc R Server for Teradata DB Run advanced analytics in- database for seamless data analysis Doc Doc R Server for Linux Bring predictive and prescriptive analytics power to your Linux environments Doc Doc
  21. 21.  http://datacamp.com 
  22. 22. Mutable Immutable Classic Open Source Java Scala .NET Now Open Source C#, C++, VB.NET F#
  23. 23.   
  24. 24. https://www.microsoft.com/en-us/cloud-platform/what-is-cortana-intelligence-suite
  25. 25. Capabilities Products Preconfigured solutions •Business scenarios •Forecasting, churn, etc. Intelligence •Integration with Cortana •Bot services •Cognitive services •Cortana •Bot Framework •Cognitive Services Dashboards and visualizations •Dashboards and visualizations •Power BI Machine learning and advanced analytics •Machine learning •Hadoop •Distributed analytics •Complex event processing •Machine Learning •HDInsight (Data Lake service) •Data Lake analytics •Stream Analytics Big data stores •Big Data repository •Elastic data warehouse •Data Lake store, Blobs •SQL Data Warehouse Information management •Data orchestration •Data catalog •Event ingestion •Data Factory •Data catalog •Event Hubs
  26. 26.   https://github.com/jakevdp/sklearn_pycon2015
  27. 27.  http://www.bing.com/explore/predicts
  28. 28.  https://techcrunch.com/2016/07/07/microsoft-now-helps-businesses-use-the-data-that-powers-bing-predicts/
  29. 29.  https://academy.microso ft.com/en- US/professional- degree/data-science/  https://borntolearn.msle arn.net/b/weblog/posts/ announcing-the- microsoft-professional- degree-mpd-program
  30. 30. http://www.kdnuggets.com/2015/09/free-data-science- books.html
  31. 31.  https://channel9.msdn.com/Blogs/Windows-Azure  https://mva.microsoft.com/   
  32. 32. http://blogs.technet.com/b/machinelearning/ http://social.msdn.microsoft.com/forums/azure/en- US/home?forum=MachineLearning http://sqlserverdatamining.com http://marktab.net http://curah.microsoft.com/342704/azure-machine-learning- videos-february-2015
  33. 33.   http://datascience.sqlpass.org/   https://www.youtube.com/channel/UCqB3xWdwjA9soFV6EOu7qfg
  34. 34.  https://doc.co/a87qpF  R Server Overview  Introduction to MicrosoftML  MicrosoftML Algorithm Cheat Sheet  Inside the Trump Bunker
  35. 35. Linked In @MarkTabNet

×