Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Industrialize AI with Enterprise Scale Machine Learning 11.7.18

504 views

Published on

Machine learning and artificial intelligence are exciting technologies, but success means excitement about business outcomes, not technology. Could success make AI boring? In this session we will cover. Scaling enterprise ML across people, process, strategy, and technology. Building and deploying automated, repeatable, and predictable ML models. A vision for an enterprise AI platform that turns data into predictions, at any scale, anywhere.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Industrialize AI with Enterprise Scale Machine Learning 11.7.18

  1. 1. INDUSTRIALIZE AI WITH ENTERPRISE SCALE MACHINE LEARNING Hilary Mason, GM of Machine Learning, Cloudera
  2. 2. 2 © Cloudera, Inc. All rights reserved. Welcome!
  3. 3. 3 © Cloudera, Inc. All rights reserved. LET’S MAKE MACHINE LEARNING BORING.
  4. 4. 4 © Cloudera, Inc. All rights reserved. AI IS CHANGING THE WORLD
  5. 5. 5 © Cloudera, Inc. All rights reserved. OR IS IT MUNDANE?
  6. 6. 6 © Cloudera, Inc. All rights reserved. MOVING FROM EXPLORATION TO PRODUCTION OF ML & AI WE’RE WITNESSING THE INDUSTRIALIZATION OF AI FROM THE LAB… TO THE FACTORY
  7. 7. 7 © Cloudera, Inc. All rights reserved. WHAT DOES GREAT AI LOOK LIKE? REDUCING CALL CENTER COSTS
  8. 8. 8 © Cloudera, Inc. All rights reserved. NEW BUSINESS OPPORTUNITIES NEW REVENUE AND NEW PRODUCT OPPORTUNITIES
  9. 9. 9 © Cloudera, Inc. All rights reserved. WORKFLOWS FOR EFFECTIVE ML DONE WELL, THE VALUE GENERATED BY MACHINE LEARNING GROWS OVER TIME 9 DEVELOPMENT PRODUCTIONSTRATEGY critical business infrastructure research and explorationprioritization and use case identification
  10. 10. 10 © Cloudera, Inc. All rights reserved. IT’S TIME TO GROW UP • Even when companies are great at this, best practices are inconsistent. • As we mature in understanding value, we’re able to address new opportunities. • Avoid common failure modes! • Optimize for scale.
  11. 11. 11 © Cloudera, Inc. All rights reserved.
  12. 12. 12 © Cloudera, Inc. All rights reserved. ENTERPRISE-GRADE SCALE WHETHER YOU ARE A FORTUNE 100 OR A STARTUP SECURITY, GOVERNANCE, COMPLIANCE STRATEGY PEOPLE & ORGANIZATION TECHNOLOGY
  13. 13. 13 © Cloudera, Inc. All rights reserved. VISION AND STRATEGY SCALE MOVING FROM SINGLE PROJECTS TO A REPEATABLE MACHINE • Strategic vision and prioritization frameworks • Who is best positioned to identify ML opportunities? • It’s not just ROI vs Cost • These are investments!
  14. 14. © Cloudera, Inc. All rights reserved. STRATEGIC INVESTMENT FRAMEWORK •IT’S NOT A SOFTWARE PROJECT, IT’S A PORTFOLIO INVESTMENT MODEL
  15. 15. 15 © Cloudera, Inc. All rights reserved. SECURITY, GOVERNANCE, COMPLIANCE
  16. 16. 16 © Cloudera, Inc. All rights reserved. FEDERATED LEARNING New research from Cloudera Fast Forward Labs • Train a model on distributed data across devices or end-points. • Share models, rather than data, preserving privacy and reducing communication costs. • Shift the burden of training out of datacenter infrastructure and onto edge devices • Webinar Nov 15th https://bit.ly/2yZsceH
  17. 17. 17 © Cloudera, Inc. All rights reserved. ETHICS OF PRACTICE IN DATA SCIENCE – FOR PRACTITIONERS Available now: https://amzn.to/2oUsZZ3
  18. 18. 18 © Cloudera, Inc. All rights reserved. SCALING PEOPLE & ORGANIZATIONS
  19. 19. 19 © Cloudera, Inc. All rights reserved. MANY FAILURE MODES What to think about • Who does data science work? • How is the org structured? • How do they work together? • How is it governed? • What’s your flavor of the ML lifecycle? • Do people trust machine learning?
  20. 20. 20 © Cloudera, Inc. All rights reserved. TECHNOLOGY SCALE
  21. 21. 21 © Cloudera, Inc. All rights reserved. THE VISION: MAKE THIS EASY Systematic process to discover and prioritize opportunities for ML and AI OPPORTUNITY DISCOVERY “AI FACTORY” Agile platform to build, train, and deploy ML applications BUSINESS TRANSFORMATION Capability to absorb business transformation and discover next opportunity
  22. 22. 22 © Cloudera, Inc. All rights reserved.22 AI MACHINE LEARNING DATA SCIENCE ANALYTICS "BIG DATA"
  23. 23. 23 © Cloudera, Inc. All rights reserved. THE FUTURE
  24. 24. 24© Cloudera, Inc. All rights reserved. OUR APPROACH MODERN ENTERPRISE PLATFORM, TOOLS AND EXPERT GUIDANCE TO HELP YOU UNLOCK BUSINESS VALUE WITH ML/AI Agile platform to build, train, and deploy scalable ML applications Enterprise data science tools to accelerate team productivity Expert guidance, services & training to fast track value & scale
  25. 25. 25 © Cloudera, Inc. All rights reserved. AS NEW TECH CAPABILITIES EMERGE, BE READY THE LATEST RESEARCH MULTI-TASK LEARNING FROM CLOUDERA FAST FORWARD LABS
  26. 26. 26 © Cloudera, Inc. All rights reserved. EVOLVING OUR DNA
  27. 27. 27 © Cloudera, Inc. All rights reserved.27 MARKET DEVELOPMENT & PHASES OF GROWTH BIG DATA TECH DATA PLATFORM CIO & Data Admins ML, ANALYTICS & CLOUD LOB & Data ScientistsIT early adopters & Developers INDUSTRIAL AI C-suite & Boards
  28. 28. 28 © Cloudera, Inc. All rights reserved. 28 enable the modern machine learning lifecycle for thousands of applications with an open enterprise platform across petabytes of data and heterogeneous compute Rapid provisioning and experimentation DevOps mindset From development to production Team collaboration and shared context Any framework, your data, your models Secure by default CPUs, GPUS, TPUs, and beyond Massive, diverse data Automation Runs anywhere
  29. 29. 29 © Cloudera, Inc. All rights reserved. HOW CAN CLOUDERA HELP CUSTOMERS INDUSTRIALIZE AI? Manage pipelines + models Deploy models Automate pipelines Monitor performance DEPLOYDEVELOP Make teams more productive Explore data Develop reports, pipelines, models Collaborate with peers TRAIN Scale resources efficiently Train models Tune parameters Track performance DELIVER THE PLATFORM TO ACCELERATE AI DEVELOPMENT AT SCALE, ANYWHERE MANAGE Run anywhere with a common architecture Manage access and resources Scale cost with usage
  30. 30. 30 © Cloudera, Inc. All rights reserved. PLATFORM FOR ENTERPRISE AI, OPTIMIZED FOR THE CLOUD NEW CONTAINERIZED MACHINE LEARNING PRODUCTS WITH A COMMON RUNTIME CLOUDERA DATA WAREHOUSE Kubernetes S3 ADLSDBMS HDFS KUDU Spark-on-YARN CLOUDERA MACHINE LEARNING DATA SCIENCE DATA ENGINEERING MODEL MANAGEMENT CLOUDERA AI RUNTIME (CPU/GPU-optimized Python/R, Spark, …) SHARED WORKSPACES FEATURE + MODEL CATALOG
  31. 31. 31 © Cloudera, Inc. All rights reserved. [future]
  32. 32. THANK YOU

×