Advertisement
Advertisement

More Related Content

Similar to AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)(20)

Advertisement
Advertisement

AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)

  1. 2020 Lenovo & byteLAKE public. All rights reserved. AI for Manufacturing Machine Vision, Edge AI, Federated Learning Robert Daigle | AI Innovation & Business Leader, Lenovo USA Marcin Rojek | Co Founder, byteLAKE www.byteLAKE.com/en/Cognitive-Services
  2. What is AI? Artificial Intelligence A program able to perform tasks normally associated with human intelligence Machine Learning A program that can perform tasks without explicit programming Deep Learning A program that uses artificial neural networks to learn data representations and perform tasks without explicit programming NLP Robotics Vision CatDog Training Dog Training Data Model Development Learn New Data Inference Model Deployment Predict PREDICTION: Dog CNN RNN classificationRegression • DL requires Large data sets for training • DL is computationally intensive Accelerators are typically used for training & inferencing • 30% of AI inferencing will be at the edge • Real-time inferencing needs low latency moving compute closer to the data
  3. Who’s leveraging AI today. 3 Enterprise Buy Verticals SMB Enterprise DIY Innovators Vertical Early Adopters & Early Majority • Limited skills • Limited data curation • Experimental DIY • Buy solutions Cloud Big 10 T1 CSP Innovators • In-house talent • Massive datasets • DIY/Build solutions • Disrupters T2 HS Emerging Tech OEM Start Ups Research Big HPC Universities Consumers • AI solutions delivered indirectly to consumers *IDC AI Spending guide 03/2020 **McKinsey AI Adoption Survey 11/2018 18% Production 31% PoC 51% Not started Current state of Enterprise AI
  4. 2020 Lenovo & byteLAKE public. All rights reserved. 4 MANUFACTURING FINANCE RETAIL HEALTH AI is Transforming Key Industries • Predictive Maintenance / Digital Twin • Quality Control / Visual Inspection • Demand forecasting • Inventory management, supply chain & logistics • Production line, robotics & process optimization • Loss Prevention • Logistics / Shelf restocking • Omni-channel & in-store analytics • customer engagement / sales automation • Check-out automation • Shopping recommendation & merchandising • Transaction payment systems • Credit decisions & Risk Management • Fraud detection & Threat Intelligence • Algorithmic trading • Process automation • Personalized banking / customer service & sales automation • Regulatory intelligence • Medical Imaging / diagnosis treatment • Clinical decisions support (CDS) • Customer service agents • Process & back office automation • Inventory mgmt, supply chain & logistics 4 industries Account for 57% of AI use-cases
  5. The Evolution of Enterprise AI 2020 Lenovo & byteLAKE public. All rights reserved. *McKinsey 19 **IDC 20 Deep Learning & Accelerated Computing Edge AI & Real-time Analytics Federated Learning of AI hardware will be at the edge.* 28% Edge AI By 2025 Connected devices, generating 41M IoT Data of data. ** 79ZB
  6. Key highlights • Algorithms optimization – making the most of hardware components – optimal usage of precious resources – faster results at the lowest possible energy consumption • Detecting shapes & patterns • Advanced data analytics • Sending results rather than raw, unprocessed data What is Edge AI? ➢ highly optimized AI engines to analyze text, image, video, sound and time series data ➢ running directly on-devices (AI inferencing)
  7. ✓Enables Scalability (Decentralizes AI services & makes it easier to expand the IoT ecosystems) ✓Enables real-time AI experience (By using modern low power, high performance, small form factor accelerators) ✓Solves round-trip latencies (Deploying AI directly on the device enables faster response time) ✓Eliminates intermittent connectivity related issues (No need for sending the data from the device to external AI services and waiting for results) ✓Reduce total cost of ownership (AI-enabled devices pre-process the data and send the results to external services vs raw data) ✓Data can stay locally on the device (Having AI on the device allows for sending the data to external storages selectively) Benefits of Edge AI 2020 Lenovo & byteLAKE public. All rights reserved.
  8. Traffic Analytics Edge AI - example More: byteLAKE.com/en/EdgeAI
  9. AI is Transforming Retail Deploying at 3000+ Retail stores Could be due to scan errors. Up to 40% Of shrinkage Identify scan errors in Real-time ticket switching, double scanning & mis-scanning Improve the customer experience Remediate errors in real-time, improving CX Increase throughput Address issues quicker with real-time notifications Computer Vision for Loss Prevention. Over $100B a year is lost due to shrinkage. 2020 Lenovo & byteLAKE public. All rights reserved.
  10. Illegal Dumping Detection More: byteLAKE.com/en/EwaGuard
  11. Leverages local AI models across Edge Devices What is AI Federated Learning? 2019 Lenovo. All rights reserved. Federated Learning AI Models Not source data Edge AI Inferencing Data Privacy Connected Edge Devices Deriving intelligence from device data Improving performance @ the edge. Why is it important? • Reduce network bandwidth constraints • Ensure privacy • Better personalization of predictions
  12. How it works? Machine Learning Sensor Data Time Local training & inferencing Edge AI Aggregating local models Federated Learning Data Center 2020 Lenovo & byteLAKE public. All rights reserved.
  13. ➢ learning to predict pressure changes (locally) ➢ learning locally & from already trained models (federated learning) Predictive Maintenance Simulation Filters Clogging Detector Fan 1 Fan 2 Barometric pressure sensor Filter 1 Filter 2 Styrofoam pellets Styrofoam pellets… … cause filters clogging & air pressure changes. 2020 Lenovo & byteLAKE public. All rights reserved.
  14. Videos: byteLAKE.com/en/FL
  15. https://youtu.be/bHo8YS5sNRE Federated Learning in action
  16. ✓Enables Scalability (Decentralized AI enables IoT/devices to learn from each other) ✓Solves low-throughput and high-latency challenges (Local AI models provide real time response and lower power consumption) ✓Improves accuracy (Have smarter models via aggregation of many local models) ✓Reduces training time (Benefit from local training and already trained models in the neighborhood) ✓Lowers the cost of training (Bringing data from all devices is expensive) ✓Ensures privacy (Sensitive data stays local) White Paper Benefits of Federated Learning 2020 Lenovo & byteLAKE public. All rights reserved.
  17. Bringing AI to manufacturing Removing the complexity of delivering a complete solution Data Collection SW Manufacturing Quality Control We need to improve our quality without slowing our production down. We’ll get an AI system!
  18. Bringing AI to manufacturing Removing the complexity of delivering a complete solution AI Consultants SW Engineers & AI Consultants Data Wranglers Data Scientist AI engineer IoT/Edge Devices Big Data & Data Mgmt. SW Big Data & Data Mgmt. HW Data Collection SW Model Dev & Mgmt. SW DevOps SW Model Dev & Mgmt. HW DevOps HW Find Solution Awareness, Demo, PoC Data Collection Extracting, storing, retrieving Data Cleaning Cleaning, formatting, labeling Model Development & Management Model Tuning & Retraining Application Development & Deployment Manufacturing Quality Control
  19. Bringing AI to manufacturing Removing the complexity of delivering a complete solution AI Consultants SW Engineers & AI Consultants Data Wranglers Data Scientist AI engineer IoT/Edge Devices Big Data & Data Mgmt. SW Big Data & Data Mgmt. HW Data Collection SW Model Dev & Mgmt. SW DevOps SW Model Dev & Mgmt. HW DevOps HW Find Solution Awareness, Demo, PoC Data Collection Extracting, storing, retrieving Data Cleaning Cleaning, formatting, labeling Model Development & Management Model Tuning & Retraining Application Development & Deployment Abstract the complexity for our customers by bringing together our ecosystem of partners. • Customized solutions • Reduced cost of deployment • Access to innovative technology
  20. Cognitive Services Build intelligent applications easily
  21. AI for Big Data AI Model Train Prepare Finding answers hidden in Big Data • Improve Client Experience (analyze past interactions / behaviors to enable personalized decisions) • Predict outcomes and trends (detect anomalies or suspicious behaviors, patterns and make recommendations) • Process Automation (document process automation, conversational chatbots, automating complex and repetitive tasks) • Better Decisions (Machine Learning, Deep Learning powered)
  22. AI for Big Data, how it works Expert System AI Engine AI Model Update Model New data processing, calibration, improving Train & Configure AI model preparation, neural network configuration Input Data Preparation, cleaning, formatting, normalization AI Model Update Time Constant Improving AI Engine
  23. Computer Vision Artificial Intelligence for Industry 4.0 <2m!
  24. 24 AI Partners Visual inspection for quality control Image diagnosis Improving patient care Virtual agents improving customer services Predictive maintenance for production up-time Fraud detection mitigating losses & risk AI use cases We need AI! “I read an article in Forbes and if we don’t have an AI strategy, we’re going to fall behind the competition!” Data sources Additional sources SensorsDevices Big Data AI-enabled applications AI development Successful AI strategy
  25. byteLAKE is a bespoke AI & HPC software company developing dynamic solutions for enterprises. Explore new possibilities with our products (AI for CFD, AI OCR for invoices w/o templates & more) and services. www.byteLAKE.com Learn more about byteLAKE & Lenovo Lenovo is building comprehensive AI solutions with our ecosystem of partners that operate on our award- winning AI hardware portfolio. Start your AI journey in the Lenovo AI Innovation Center. www.Lenovo.com/AI
  26. 26
  27. APPENDIX
  28. AI • highly optimized AI engines to analyze text, image, video, sound and time series data. • Detecting shapes & patterns. • Complex tasks automation. • IoT/ edge, Cloud, on-premise. HPC • accelerating time to results and adapting complex algorithms to GPU, FPGA, many-CPU architectures. • From single nodes to clusters. Meet byteLAKE AI and HPC Experts Your software partner for AI & HPC projects Experts in adapting & optimizing software for Select Products AI for CFD. Ultra fast results, radically lower TCO. New possibilities. Objects Detection Edge AI and real time computer vision. 56x faster AI training. R&I • R&D • Licensing
  29. Products and Services Cognitive AutomationEdge AI Services HPC Products CFD Suite AI for CFD / Fluid Dynamics Brainello AI OCR for invoices, no templates Ewa Guard Machine Vision Cognitive Services AI for Manufacturing, Big Data Green Computing (FPGA, GPU) Intelligent Restaurant Incubation
  30. CFD Suite Collection of innovative AI Models for computational fluid dynamics. byteLAKE.com/en/CFDSuite Product Launch November 2020 AI for CFD Computational Fluid Dynamics
  31. brainello • Documents processing automation • 1800 invoices processed / hour ! • No templates needed. AI powered. • Learning over time
  32. Lenovo’s AI Inference Portfolio (Edge AI) ThinkSystem SR630 Benefits • Tensor cores • GPUs: 2x PCIe Gen3 singlewide accelerators – T4 • 2x Xeon • High speed interconnects – 200Gb HDR, 100GbE or EDR • Enterprise management – BMC/XCC • NVIDIA EGX Certified - Pending Usage: • Computer vision, large data stream ingest, edge environments, HCI supporting diverse workloads, ThinkSystem SR670 & SR650 Benefits • Tensor cores • 3-4x PCIe Gen3 Doublewide Accelerators - V100 (V100S, RTX6000 & RTX8000 in plan) • 5-8x PCIe Gen3 singlewide accelerators – T4 • 2x 205W Xeon SP Gen2 • High speed interconnects for cluster/scale-out – 200Gb HDR, 100GbE or EDR • Enterprise management – BMC/XCC • NVIDIA NGC & EGX Certified • LiCO Ready Usage: • Dense inferencing workloads in DC or micro DC, Computer vision, large data stream ingest, edge environments, HCI supporting diverse workloads, ThinkSystem SE350 Benefits • Tensor cores • GPU - PCIe Gen3 singlewide accelerators – T4 • Xeon class - 16 core Xeon D • 10GbE, Wifi & LTE connectivity • Enterprise & remote management – BMC/XCC • NVIDIA EGX Certified • Highly secure – fully encrypted & tamper detection • Ruggedized - up to 55°C environment Usage: • Computer vision, large data stream ingest, edge environments, HCI supporting diverse workloads, Tiny Benefits • GPU P1000 • Lower cost • Ruggedized Usage: • Computer vision, data ingest, edge environments Nano IoT, EPC300, IoT500 Benefits • Wired and Wireless connectivity: WiFi / WAN Enabled 4G/LTE/LoRa/NB-IoT • Ruggedized: IP65 level Dust Proof, -20-60c Extended OP temp, MIL-STD-810G, Railway EN50121 certified • Fanless • Greengrass, Win10 IoT, Ubnuntu support
  33. Lenovo’s AI Training Portfolio ThinkStation P520 ThinkStation P920 Benefits • LiCO Ready* • NVIDIA NGC Certified • Supports enterprise grade GPUs including GV100 & RTX 6000 & 8000 Usage Start fast, lower cost than cloud *Pending LiCO support ThinkSystem SR670 Benefits • 4x PCIe Gen3 Doublewide Accelerators - V100 (V100S, RTX6000 & RTX8000 in plan) • 8x PCIe Gen3 singlewide accelerators – T4 • 2x 205W Xeon SP Gen2 • High speed interconnects for cluster/scale-out – 200Gb HDR, 100GbE or EDR • Enterprise management – BMC/XCC • NVIDIA NGC & EGX Certified • LiCO Ready • Cluster-ready Scalable solution • Multi-user, multi-job support Usage ML & Deep Learning training, ThinkSystem SR650 Benefits • 2x PCIe Gen3 Doublewide Accelerators - V100 (V100S, RTX6000 & RTX8000 in plan) • 5x PCIe Gen3 singlewide accelerators – T4 • 2x 205W Xeon SP Gen2 • High speed interconnects for cluster/scale-out – 200Gb HDR, 100GbE or EDR • Enterprise management – BMC/XCC • LiCO Ready • Cluster-ready Scalable solution • Multi-user, multi-job support Usage Mixed workloads,
  34. Lenovo ThinkSystem SR670 34 ▪ Ultimate HPC/AI Building Block ▪ Modular Four GPU Server ▪ Optimized for: ▪ AI - ML/DL + VDI workloads ▪ All types of HPC Workloads ▪ New NVIDIA Tesla T4 ▪ 8 GPU Support ▪ Optimized for ▪ AI Performance/$/watt ▪ Outstanding AI Inference ▪ Visualization (VDI) ▪ Expanded Support NEW!
  35. SE350 Edge Server NVIDIA Tesla T4 Support
Advertisement