SlideShare a Scribd company logo
1 of 23
Download to read offline
Generative AI Rennes
WAICF highlights & how to deploy
an Open Source LLM in the Cloud
THIBAUD LE DOUARIN | MAËL LE GAL
15.02.24
Generative AI Rennes 2
Thibaud LE DOUARIN
Product Manager
Maël LE GAL
Machine Learning & Big Data
Software Engineer
Generative AI Rennes 3
Agenda
World AI Cannes Festival
01 Highlights and latest trends
Gen AI by OVHcloud
02 GPUs and solutions to democratize AI
Demo
03 Deploy an Open Source LLM in minutes
Generative AI Rennes 4
World AI Cannes Festival
Highlights and latest trends
01
16000
Expected attendees
300
International Speakers
250
Sessions
230
Exhibitors
Generative AI Rennes 5
The Event
WAICF 2024 in figures
250
Sessions
Generative AI Rennes 6
The Event
WAICF 2024 in figures
60
Demo sessions
24
Tech & Strat conferences
25
Case studies
20%
Infra, desktop, compliance,
deploy, safety...
17%
Tips for success,
promises vs reality...
28%
Pharma, bank, finance,
internal uses...
Trends
Generative AI Rennes 7
OVHcloud picked up insights
Use of existing models
Rich opensource model catalog
Deployment
Privacy and safety
Few training use cases
Generative AI opened trainingless use cases
Retrieval-augmented generation
Specialisation and document chat
AI
Market trends
Generative AI Rennes 8
Generative AI Segment Forecast ($M) & CAGR (2023-2028)
Source: S&P Global / 451 Research Nov-23 “Generative AI Market Monitor
$0
$5 000
$10 000
$15 000
$20 000
$25 000
$30 000
$35 000
$40 000
$45 000
2023 2024 2025 2026 2027 2028
Numeric / Structured Data Generators
Code Generators
Audio Generators
Video Generators
Image Generators
Text Generators
Foundation Models
AI Opportunities
Generative AI Rennes 9
Generative AI products unlock efficiency and cost savings for any organizations
Customer operations - 38%
Customer self-service
Resolution during initial contact
Reduced response time
Increased sales
Software engineering - 31%
Initial code drafts
Code correction and refactoring
Root-cause analysis
Marketing - 10%
Content creation & SEO
Enhanced use of data
Product discovery and search
personalization
Sales - 4%
Increase probability of sale
Improve lead development
Source: McKinsey Jun-23 "The economic potential of generative AI: The next productivity frontier"
AI Opportunities
Generative AI Rennes 10
Most companies are still experimenting with AI
63%
AI Experimentors
13%
AI Innovators
12%
AI Achievers
12%
AI Builders
AI Experimentors
Companies that lack mature AI strategies and the
capabilities to operationalize
AI Innovators
Companies that have mature AI strategies but
struggle to operationalize
AI Achievers
Companies that have differentiated AI strategies
and the ability to operationalize for value
AI Builders
Companies that have mature foundational
capabilities that exceed their AI strategies
Source: Accenture Research analysis based on a sample of 1200 companies.
"
Generative AI Rennes 11
The future of AI, I tell you, is non-generative.
It works for text, doesn't work for anything else.”
Vice-President and Chief AI Scientist
META AI
Yann LECUN
Generative AI Rennes 12
Gen AI by OVHcloud
GPUs and solutions to democratize AI
02
Generative AI Rennes 13
I need a
GPU
for
extreme fine-tuning and
training, demanding model
inference, LLM projects
deep-learning training or
inference, generative AI,
LLM projects
advanced training and
inference of AI models
enhanced AI capabilities
workloads
V100S
H100 ALREADY AVAILABLE
A100
L40S
ALREADY AVAILABLE
03/2024
L4 03/2024
ALREADY AVAILABLE
Generative AI Rennes | *OVHcloud benchmark, comparison of BERT training on NVIDIA V100S, A100, H100. 14
OVHcloud benchmark of NVIDIA V100S, A100, H100
GPU Train scores, BERT, smart throughput (fp16)*
49,3
91,48
146,6
0 20 40 60 80 100 120 140 160
V100
A100
H100
0,2
0,3
0,42
0 0,1 0,2 0,3 0,4 0,5
V100
A100
H100
Throughput per second Throughput per watt
Generative AI Rennes | *OVHcloud benchmark, comparison of BERT training on NVIDIA V100S, A100, H100. 15
OVHcloud benchmark of NVIDIA V100S, A100, H100
For a dataset with 1 million tokens, BERT results (fp16, 1 epoch)*
5,5
3
1,9
0 1 2 3 4 5 6
V100S
A100
H100
1375
900
665
0 200 400 600 800 1000 1200 1400 1600
V100S
A100
H100
Training time, in hours Watt consumption during said training
Generative AI Rennes 16
NVIDIA GPUs at OVHcloud
Using a sustainable infrastructure
0.18kg/CO2/kWh
CUE
1.29
PUE
0.3L/kWh
WUE
91%
REF
Generative AI Rennes 17
NVIDIA GPUs at OVHcloud
How to use them
Bare Metal
Your own server
Public Cloud Compute
Your own instance and kubernetes cluster
AI Solutions
Your serverless AI toolbox
Generative AI Rennes 18
The AI journey at OVHcloud
AI Notebooks
EXPLORE
PRE-PROCESS
Data processing AI Deploy
DEPLOY
High Performance
Object Storage
STORE
AI Training
TRAIN
Generative AI Rennes 19
Data Engineer Data Analyst Data Scientist
Generative AI Rennes 20
Developer
Generative AI Rennes 21
AI Endpoints: a catalogue of AI Services
to easily incorporate AI into your products
AI App Builder: deploy production-ready
generative AI applications in minutes
Generative AI Rennes
Generative AI Rennes 23
DEMO
Deploy an Open Source LLM in minutes
03

More Related Content

Similar to Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy an Open Source LLM in the Cloud

Accelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSAccelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSSri Ambati
 
SCL Corporate Presentation
SCL Corporate PresentationSCL Corporate Presentation
SCL Corporate PresentationSergio Porcar
 
Artificial Intellige by example.pdf
Artificial Intellige by example.pdfArtificial Intellige by example.pdf
Artificial Intellige by example.pdfsandipanpaul16
 
Internet of Things: The future is here
Internet of Things: The future is hereInternet of Things: The future is here
Internet of Things: The future is hereNagarro
 
Accenture and Worksoft Explain Why Businesses Need a Digital Testing Strategy
Accenture and Worksoft Explain Why Businesses Need a Digital Testing StrategyAccenture and Worksoft Explain Why Businesses Need a Digital Testing Strategy
Accenture and Worksoft Explain Why Businesses Need a Digital Testing StrategyWorksoft
 
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)DevOps as a Service - our own true story with a happy ending (JuCParis 2018)
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)Philippe Ensarguet
 
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017Joe Braun
 
Synaptics CRC Final Presentation
Synaptics CRC Final PresentationSynaptics CRC Final Presentation
Synaptics CRC Final PresentationJake White
 
AI Solutions in Manufacturing
AI Solutions in ManufacturingAI Solutions in Manufacturing
AI Solutions in ManufacturingSri Ambati
 
5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentationSenthilkumar R
 
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...ThousandEyes
 
Transforming your business through data driven insights and action with Azure
Transforming your business through data driven insights and action with AzureTransforming your business through data driven insights and action with Azure
Transforming your business through data driven insights and action with AzureInovar Tech
 
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStream
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStreamIoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStream
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStreamgogo6
 
Implementing and running a secure datalake from the trenches
Implementing and running a secure datalake from the trenches Implementing and running a secure datalake from the trenches
Implementing and running a secure datalake from the trenches DataWorks Summit
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing cosma_r
 
How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...NUS-ISS
 
Infrastructure Solutions for Deploying AI/ML/DL Workloads at Scale
Infrastructure Solutions for Deploying AI/ML/DL Workloads at ScaleInfrastructure Solutions for Deploying AI/ML/DL Workloads at Scale
Infrastructure Solutions for Deploying AI/ML/DL Workloads at ScaleRobb Boyd
 
Accenture-IXO-Industry-Insights-AutoOES.pdf
Accenture-IXO-Industry-Insights-AutoOES.pdfAccenture-IXO-Industry-Insights-AutoOES.pdf
Accenture-IXO-Industry-Insights-AutoOES.pdfNatliaVial
 

Similar to Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy an Open Source LLM in the Cloud (20)

Accelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSAccelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWS
 
SCL Corporate Presentation
SCL Corporate PresentationSCL Corporate Presentation
SCL Corporate Presentation
 
Artificial Intellige by example.pdf
Artificial Intellige by example.pdfArtificial Intellige by example.pdf
Artificial Intellige by example.pdf
 
Internet of Things: The future is here
Internet of Things: The future is hereInternet of Things: The future is here
Internet of Things: The future is here
 
Accenture and Worksoft Explain Why Businesses Need a Digital Testing Strategy
Accenture and Worksoft Explain Why Businesses Need a Digital Testing StrategyAccenture and Worksoft Explain Why Businesses Need a Digital Testing Strategy
Accenture and Worksoft Explain Why Businesses Need a Digital Testing Strategy
 
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)DevOps as a Service - our own true story with a happy ending (JuCParis 2018)
DevOps as a Service - our own true story with a happy ending (JuCParis 2018)
 
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017
Synaptics Runner-Up Deck - Cleveland Research Company Stock Pitch 2017
 
Synaptics CRC Final Presentation
Synaptics CRC Final PresentationSynaptics CRC Final Presentation
Synaptics CRC Final Presentation
 
AI Solutions in Manufacturing
AI Solutions in ManufacturingAI Solutions in Manufacturing
AI Solutions in Manufacturing
 
5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation
 
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...
How Schneider Electric Assures Its Salesforce Lightning Migration with Thousa...
 
Transforming your business through data driven insights and action with Azure
Transforming your business through data driven insights and action with AzureTransforming your business through data driven insights and action with Azure
Transforming your business through data driven insights and action with Azure
 
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStream
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStreamIoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStream
IoT Meets Big Data: The Opportunities and Challenges by Syed Hoda of ParStream
 
IoT-Use-Case-eBook
IoT-Use-Case-eBookIoT-Use-Case-eBook
IoT-Use-Case-eBook
 
Implementing and running a secure datalake from the trenches
Implementing and running a secure datalake from the trenches Implementing and running a secure datalake from the trenches
Implementing and running a secure datalake from the trenches
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing
 
How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...
 
Infrastructure Solutions for Deploying AI/ML/DL Workloads at Scale
Infrastructure Solutions for Deploying AI/ML/DL Workloads at ScaleInfrastructure Solutions for Deploying AI/ML/DL Workloads at Scale
Infrastructure Solutions for Deploying AI/ML/DL Workloads at Scale
 
Kba symposium 6th april
Kba symposium 6th aprilKba symposium 6th april
Kba symposium 6th april
 
Accenture-IXO-Industry-Insights-AutoOES.pdf
Accenture-IXO-Industry-Insights-AutoOES.pdfAccenture-IXO-Industry-Insights-AutoOES.pdf
Accenture-IXO-Industry-Insights-AutoOES.pdf
 

Recently uploaded

Fuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyFuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyRafigAliyev2
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictJack Cole
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxDilipVasan
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdfvyankatesh1
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理pyhepag
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理cyebo
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理pyhepag
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理pyhepag
 
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPsWebinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPsCEPTES Software Inc
 
Data analytics courses in Nepal Presentation
Data analytics courses in Nepal PresentationData analytics courses in Nepal Presentation
Data analytics courses in Nepal Presentationanshikakulshreshtha11
 
Pre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxPre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxStephen266013
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Calllward7
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理cyebo
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group MeetingAlison Pitt
 
Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfscitechtalktv
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理pyhepag
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Jon Hansen
 
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfGenerative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfEmmanuel Dauda
 

Recently uploaded (20)

Fuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertaintyFuzzy Sets decision making under information of uncertainty
Fuzzy Sets decision making under information of uncertainty
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdf
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
 
Machine Learning for Accident Severity Prediction
Machine Learning for Accident Severity PredictionMachine Learning for Accident Severity Prediction
Machine Learning for Accident Severity Prediction
 
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPsWebinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
 
Data analytics courses in Nepal Presentation
Data analytics courses in Nepal PresentationData analytics courses in Nepal Presentation
Data analytics courses in Nepal Presentation
 
Pre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxPre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptx
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call
 
Slip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp ClaimsSlip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp Claims
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting
 
Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdf
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)
 
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfGenerative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
 

Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy an Open Source LLM in the Cloud

  • 1. Generative AI Rennes WAICF highlights & how to deploy an Open Source LLM in the Cloud THIBAUD LE DOUARIN | MAËL LE GAL 15.02.24
  • 2. Generative AI Rennes 2 Thibaud LE DOUARIN Product Manager Maël LE GAL Machine Learning & Big Data Software Engineer
  • 3. Generative AI Rennes 3 Agenda World AI Cannes Festival 01 Highlights and latest trends Gen AI by OVHcloud 02 GPUs and solutions to democratize AI Demo 03 Deploy an Open Source LLM in minutes
  • 4. Generative AI Rennes 4 World AI Cannes Festival Highlights and latest trends 01
  • 6. 250 Sessions Generative AI Rennes 6 The Event WAICF 2024 in figures 60 Demo sessions 24 Tech & Strat conferences 25 Case studies 20% Infra, desktop, compliance, deploy, safety... 17% Tips for success, promises vs reality... 28% Pharma, bank, finance, internal uses...
  • 7. Trends Generative AI Rennes 7 OVHcloud picked up insights Use of existing models Rich opensource model catalog Deployment Privacy and safety Few training use cases Generative AI opened trainingless use cases Retrieval-augmented generation Specialisation and document chat AI
  • 8. Market trends Generative AI Rennes 8 Generative AI Segment Forecast ($M) & CAGR (2023-2028) Source: S&P Global / 451 Research Nov-23 “Generative AI Market Monitor $0 $5 000 $10 000 $15 000 $20 000 $25 000 $30 000 $35 000 $40 000 $45 000 2023 2024 2025 2026 2027 2028 Numeric / Structured Data Generators Code Generators Audio Generators Video Generators Image Generators Text Generators Foundation Models
  • 9. AI Opportunities Generative AI Rennes 9 Generative AI products unlock efficiency and cost savings for any organizations Customer operations - 38% Customer self-service Resolution during initial contact Reduced response time Increased sales Software engineering - 31% Initial code drafts Code correction and refactoring Root-cause analysis Marketing - 10% Content creation & SEO Enhanced use of data Product discovery and search personalization Sales - 4% Increase probability of sale Improve lead development Source: McKinsey Jun-23 "The economic potential of generative AI: The next productivity frontier"
  • 10. AI Opportunities Generative AI Rennes 10 Most companies are still experimenting with AI 63% AI Experimentors 13% AI Innovators 12% AI Achievers 12% AI Builders AI Experimentors Companies that lack mature AI strategies and the capabilities to operationalize AI Innovators Companies that have mature AI strategies but struggle to operationalize AI Achievers Companies that have differentiated AI strategies and the ability to operationalize for value AI Builders Companies that have mature foundational capabilities that exceed their AI strategies Source: Accenture Research analysis based on a sample of 1200 companies.
  • 11. " Generative AI Rennes 11 The future of AI, I tell you, is non-generative. It works for text, doesn't work for anything else.” Vice-President and Chief AI Scientist META AI Yann LECUN
  • 12. Generative AI Rennes 12 Gen AI by OVHcloud GPUs and solutions to democratize AI 02
  • 13. Generative AI Rennes 13 I need a GPU for extreme fine-tuning and training, demanding model inference, LLM projects deep-learning training or inference, generative AI, LLM projects advanced training and inference of AI models enhanced AI capabilities workloads V100S H100 ALREADY AVAILABLE A100 L40S ALREADY AVAILABLE 03/2024 L4 03/2024 ALREADY AVAILABLE
  • 14. Generative AI Rennes | *OVHcloud benchmark, comparison of BERT training on NVIDIA V100S, A100, H100. 14 OVHcloud benchmark of NVIDIA V100S, A100, H100 GPU Train scores, BERT, smart throughput (fp16)* 49,3 91,48 146,6 0 20 40 60 80 100 120 140 160 V100 A100 H100 0,2 0,3 0,42 0 0,1 0,2 0,3 0,4 0,5 V100 A100 H100 Throughput per second Throughput per watt
  • 15. Generative AI Rennes | *OVHcloud benchmark, comparison of BERT training on NVIDIA V100S, A100, H100. 15 OVHcloud benchmark of NVIDIA V100S, A100, H100 For a dataset with 1 million tokens, BERT results (fp16, 1 epoch)* 5,5 3 1,9 0 1 2 3 4 5 6 V100S A100 H100 1375 900 665 0 200 400 600 800 1000 1200 1400 1600 V100S A100 H100 Training time, in hours Watt consumption during said training
  • 16. Generative AI Rennes 16 NVIDIA GPUs at OVHcloud Using a sustainable infrastructure 0.18kg/CO2/kWh CUE 1.29 PUE 0.3L/kWh WUE 91% REF
  • 17. Generative AI Rennes 17 NVIDIA GPUs at OVHcloud How to use them Bare Metal Your own server Public Cloud Compute Your own instance and kubernetes cluster AI Solutions Your serverless AI toolbox
  • 18. Generative AI Rennes 18 The AI journey at OVHcloud AI Notebooks EXPLORE PRE-PROCESS Data processing AI Deploy DEPLOY High Performance Object Storage STORE AI Training TRAIN
  • 19. Generative AI Rennes 19 Data Engineer Data Analyst Data Scientist
  • 20. Generative AI Rennes 20 Developer
  • 21. Generative AI Rennes 21 AI Endpoints: a catalogue of AI Services to easily incorporate AI into your products AI App Builder: deploy production-ready generative AI applications in minutes
  • 23. Generative AI Rennes 23 DEMO Deploy an Open Source LLM in minutes 03