Cloud Artificial Intelligence Landscape
•
3 likes•387 views
Talk by Konstantin Savenkov (Intento, Inc.) at Developer Week 2019 (Seattle: Cloud Edition). There are already hundreds of AI functions available via different APIs. Pick Machine Translation, Sentiment Analysis, Image Tagging or anything else - there's already a choice of 20-30 AI vendors to pick from. I will make a brief overview of what types of models are already available in the cloud, which of those enable customization and important things to look after when selecting the model (or a set of those) for a specific project. I will also touch AI API developer experience, to give an idea what a developer should be prepared for when choosing the API to work with. https://devweeksea2019.sched.com/event/OGSp/pro-talk-cloud-ai-landscape
Recommended
More Related Content
What's hot
What's hot (11)
Similar to Cloud Artificial Intelligence Landscape
Similar to Cloud Artificial Intelligence Landscape (20)
More from Konstantin Savenkov
More from Konstantin Savenkov (12)
Recently uploaded
Recently uploaded (20)
Cloud Artificial Intelligence Landscape
- 1. CLOUD ARTIFICIAL INTELLIGENCE LANDSCAPE Konstantin Savenkov © Intento, Inc. May 2019
- 2. Agenda • Modern AI Stack is Deep • Few can master it in-house. There are many stock models available in the cloud. • Cloud AI Landscape: Text, Image, Audio, Video • Domain specificity: pre-trained models, custom models, pre-trained vertical models, domain adaptation • Quality evaluation: why and how? • Machine Translation example • Project reqs: domain, quality, price, language support • Integration reqs: Synchronous, Batch, Asynchronous, Streaming. • Business reqs: data protection, deployment, geography, payment INTENTO© Intento, Inc. / May 2019
- 3. AI STACK IS DEEP !3 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation http://www.shivonzilis.com/machineintelligenc© Intento, Inc. / May 2019
- 4. FEW CAN MASTER IT IN-HOUSE !4 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO of all companies put AI into production 20%
- 5. A PLENTY OF CLOUD AI !5 APIs 200+ intents 100+ AI models 20,000+ INTENTO© Intento, Inc. / May 2019
- 6. Programmable Web !6 INTENTO Major AI Vendors AI API Marketplaces Indie AI Vendors A PLENTY OF CLOUD AI © Intento, Inc. / May 2019
- 7. COGNITIVE AI INTENTS !7© Intento, Inc. / September 2018 EXTRACT CLASSIFY TRANSFORM OTHER TEXT 8 8 4 4 IMAGE 9 10 7 5 AUDIO 3 3 3 VIDEO 14 4 1 © Intento, Inc. / May 2019
- 8. CLOUD AI - TEXT !8 Entity Extraction — Linguistic Analysis — Keyword Extraction — Phrase Extraction — Concept Extraction — Clean Text Extraction — Intent Extraction — Split Into Sentences INTENTO evaluate source onboard Sentiment Analysis — Categorization — Language Detection — Topic Tagging — Content Moderation — Writer Traits Detection — Difficulty Scoring — Quality Scoring Machine Translation — Summarization — Text Correction — Transliteration EXTRACT CLASSIFY TRANSFORM © Intento, Inc. / May 2019
- 9. CLOUD AI - IMAGE !9 OCR — Face Detection — Landmark Detection — Logo Detection — Object Detection — Human Body Detection — Celebrity Recognition — Image Properties Extraction — Body Keypoints Recognition INTENTO evaluate source onboard Image Tagging — Face Quality Analysis — Body Attribute Extraction — Image Type Detection — Image Moderation — Virality Detection — Image Quality Detection — Emotion Recognition — Gesture Recognition Face Fusion — Crop Hints — Thumbnail Generation — Quality Improvement — Style Transfer — Image Colorization — Image Inpainting EXTRACT CLASSIFY TRANSFORM © Intento, Inc. / May 2019
- 10. CLOUD AI - AUDIO !10 Speech-To-Text — Word Position Markers — Keyword Extraction — Audio Summarization — Speaker Diarization INTENTO evaluate source onboard Speaker Verification — Speaker Identification — Emotion Recognition Text-To-Speech — Speech Translation — Denoising EXTRACT CLASSIFY TRANSFORM © Intento, Inc. / May 2019
- 11. CLOUD AI - VIDEO !11 Label Detection — Shot Change Detection — Face Detection — Speaker Deteciton — Celebrity Recognition — Logo Recognition — Person Tracking — Transcription — OCR — Voice Separation — Scene Analysis INTENTO evaluate source onboard Video Classification — Content Moderation — Emotion Recognition — Sentiment Analysis Translation — EXTRACT CLASSIFY TRANSFORM © Intento, Inc. / May 2019
- 12. !12 23 intents 60+ APIs © Intento, Inc. / Confidential / June 2018 EXAMPLE: NLP APIS © Intento, Inc. / May 2019
- 13. CUSTOM VS. GENERIC !13 custom AI models — pre-trained generic models — pre-trained domain-specific models — domain-adaptive models: - data augmentation - transfer learning - dynamic adaptation INTENTO© Intento, Inc. / May 2019
- 14. AI QUALITY !14 baseline models: language and domain support — domain adaptation: learning curves — de-noising: for training and input data — evaluation: reference-based, expert judgement, automated — dynamic: constantly changing INTENTO© Intento, Inc. / May 2019
- 15. !15© Intento, Inc. / Confidential / June 2018 EXAMPLE: MACHINE TRANSLATION © Intento, Inc. / May 2019
- 16. !16© Intento, Inc. / Confidential / June 2018 EXAMPLE: MACHINE TRANSLATION BASELINE MODELS © Intento, Inc. / May 2019
- 17. !17© Intento, Inc. / Confidential / June 2018 EXAMPLE: MACHINE TRANSLATION LEARNING CURVES Starting dataset sizes vary — Learning curves vary — Depends on language pair and domain © Intento, Inc. / May 2019
- 18. !18© Intento, Inc. / Confidential / June 2018 EXAMPLE: MACHINE TRANSLATION REFERENCES State of the Machine Translation (Jan 2019) State of the Domain-Adaptive Machine Translation (Nov 2019) https://bit.ly/stock_mt_jan2019 https://bit.ly/custom_mt_nov2018 © Intento, Inc. / May 2019
- 19. OTHER FACTORS PROJECT REQUIREMENTS !19 INTENTO Price: 100x-300x price difference — TCO: depends on scenario, different business models — Language Support: native vs Machine Translation © Intento, Inc. / May 2019
- 20. OTHER FACTORS TECHNICAL REQUIREMENTS !20 INTENTO Mode: Sync, Batch, Async, Streaming — Plugins, Connectors, SDK © Intento, Inc. / May 2019
- 21. OTHER FACTORS BUSINESS REQUIREMENTS !21 INTENTO Data Protection: Free!, Limited (Rights Claimed), Full, No-Trace — Deployment Options: Cloud, Certified Cloud, Private Cloud, On- Prem — Regional Options: DC Availability, Data Locality — Contracting and Payment: Regional restrictions © Intento, Inc. / May 2019
- 22. CONCLUSIONS !22 INTENTO lots of niche AI models with APIs — 10-20 vendors per intent / function — complex performance / price landscape — filter candidate models by requirements — then evaluate quality on your data © Intento, Inc. / May 2019
- 23. THANK YOU! !23 Konstantin Savenkov ks@inten.to 2150 Shattuck Ave Berkeley CA 94705 INTENTO https://inten.to Konstantin Savenkov ks@inten.to