SlideShare a Scribd company logo
1 of 104
Download to read offline
H2O.ai Confidential
Democratize AI with H2O.ai
8
7
222OF
THE
H2O
OF THE TOP 10
BANKS
OF THE TOP 10
4 OF THE TOP 10
MANUFACTURING
COMPANIES
INSURANCE
COMPANIES
FORTUNE
500
CUSTOMER OBSESSION
MAKER CULTURE
Commonwealth Bank, Goldman Sachs,
Wells Fargo, NVIDIA, Capital One, Nexus
Ventures, New York Life
2M
Community
30
Kaggle Grandmasters
2012
FOUNDED IN
SILICON VALLEY
$256M
FUNDRAISED,
SUSTAINABLE
Open Source is freedom, not free!
Democratize AI
AI for Good
H2O.ai Confidential
H2O.ai Confidential
H2O products are backed by 10% of the World’s Data Science
Grandmasters and a Team of Experts who are relentless in
solving critical problems.
KAGGLE GRANDMASTERS World’s Best Data Scientists
2 Quadruple GMs
1 Triple GM
7 Double GMs
#1 KGM
#3 KGM
5 Top 10 Globally
10 Kaggle Masters
H2O.ai KGM HIGHLIGHTS
● 2023 H2O KGMs win 3
healthcare-related
competitions
● July 2023 H2O KGMs make
“Top GenAI Scientists” list
● Oct 2023 H2O paper accepted
at EMNLP 2023
● Nov 2023 H2O KGMs win 1st
place in Kaggle Science Exam
competition
● Jan 2024 H2O KGM places 2nd
in Detect AI Text competition
● Feb 2024 introduced
foundational model
H2O-Danube 1.8b
Co-create
H2O.ai Confidential
Generative AI
Predictive AI
Generative AI
AWARD-WINNING AUTOML reaches
a new audience with chat & function
calling assistants for ML
Enhanced AI for Documents
Automation for data labeling
Automation of code for AI Apps
CUSTOMGPTS: H2O foundational
models, fine-tuned models, personality,
on top of predictive models
Convergence of World’s best Predictive and Generative AI
GenAI Apps
Enterprise h2oGPTe: Python
APIs and UI for chat, RAG
customGPTs
Function-calling & Agents
Prompt Tuning
Foundational Models
document and data labeling
on-premise, air-gapped,
cloud VPC | SaaS
+
H2O.ai Confidential
GenAI AppStudio
Structured
Datasets
Unstructured
Datasets
ETL / Prep for LLMs
Documents → QA Pairs
Fine Tuning LLMs
(& Prompts)
End Users
Vector DB
(Embeddings
)
myGPT
R. A. G.
Talk to your Data
Document QA
Document Chat
Image/Video Chat
LLM Query
GenAI Apps
+ +
+ +
+
+
LLM
Data Studio
AI Engines MLOps
EvalStudio
AI Apps
+ LLMs
Integration
LLMOps
API
Prompt
Studio
Continuous
Feedback
Parsing . Chunking
Indexing . Embeddings
LLM Agents
Chat / QA
Prompt Engineering
LLM
Workers
Enterprise h2oGPTe (RAG)
Make Your
Own Eval
Predictive AI Layer Predictive + Gen AI
h2o-functions
World’s Best AI to do Gen AI
Tabular
Data
Raise a forest, not just a tree.
Make ecosystems
H2O.ai Confidential
Hyperscalers
Technology
VARs/
Distributors
Successful Partnerships
Reduce complexity of the
sales process through
Marketplace. Collaborative
sales strategy.
Co-sell and integration to
accelerate inferencing on
end-to-end workflows.
Gain business agility with
faster time to market
Simplified procurement process,
flexible terms, simplified
deployment. Seamless integration
with cloud providers solutions.
Flexible deployment options,
Breakthrough cost reduction and
ROI. Secure, data never leaves the
environment
Access to expertise, custom
solutions, and seamless
integration, reducing the pain and
time of ML/Gen AI adoption
Strategic Fit Customer Value
Industry
Co-create GenAI solutions
related to various industry
specific problem statements
Faster time to market, rapid
innovation and developing
cutting-edge GenAI offerings
Public Sector Expansion into new agencies
Access to enterprise ready
solutions
Tech Ecosystem of H2O GenAI
OPEN SOURCE MODELS
VECTOR DATABASES
CLOSE SOURCE MODELS
LLM INFERENCING HARDWARE MODEL
HOSTING
CLOUD PROVIDERS
Thank you, Community.
Gratitude.
Makers, past, present and future!
H2O Movement
Community and Customers!
To all greatness, our greetings
endaro mahanubhavulu
Data Scientist = 100% data
Business Unit = 85% data, 15% storytelling
Executive = 15% data, 85% storytelling
Board = 99% storytelling
GrandPa = 100% storytelling
Prompt is your intellectual property
Everyone needs their own GPT
Every Nation needs to be an AI Nation
Private
On-prem, behind your firewall
Sovereign Data
Sovereign AI
H2O.ai Confidential
Documents
Data Sources
LLM
DataStudio myGPT
LLM
EvalStudio
Vector DB
(Embeddings)
Alternative
Datasets
Query + Documents
(Context)
Talk to Your Data
Ques Answers
Context Search
Doc Retrieval
Similar Doc
Personalization
Contextual Similarity
Continuous Eval
(feedback)
GenAI App Store
End User
+ +
+ +
+
+
Data AI Engines AI Apps LLM
Integration
Models
Data to QA pairs
ETL for LLMs
LLM Fine Tuning
Custom GPT
API
Embeddings
DataStore
The Whole Ecosystem of AI with GenAI to deliver Impact
LLMOps
Prompt
Studio
Time is the only non-renewable resource
Open Source Foundation Models
H2O Danube 2 LLM 1.8B, 2T Tokens, 4K seq length
fp8 precision during training (quantization)
Grouped Query Attention
(Dropped Windowing; Mistral Tokenizer)
Compute 7,600 GPU hrs, (8xH100, 45 days)
Inference is efficient. Embeddable.
Cost efficient! (lot less than you think!)
Ready to pre-train on your data!
Democratizing Foundation LLMs
Using LLM Studio
DPO,
with good chat data
Fine-Tuned for Chat
Open Source h2oGPT
Fine-tuning and RAG of Best-in-class Open Source LLMs
Open Source H2O LLM Studio
Best-in-class Studio to fine-tune LLMs
Enterprise h2oGPTe
Best-in class RAG and API to power GenAI Apps
H2O EvalStudio
Evaluation-led building of LLM-powered Applications
Open Source H2O EvalGPT
Evaluate LLMs for public and private benchmarks
LLM-Based Evaluation
Prompt/Context and
Document Embedding
Dimensionality Reduction
and Clustering
Cluster/Topic
Summarization
Auto Prompt Generation
Prompt Perturbation
• Invariance
• Adversarial
Robustness
• Performance Drop
Stratified Sampling
Weakness Detection
• Weak clusters/topics
Resilience
• Performance under
distribution shift
Interpretability Outcome Analysis: Cluster
Eval
Input-Output
Visualization
Diagnostics
Converging Predictive AI and Generative AI
H2O Agents
Converging Predictive AI and Generative AI
H2O Document AI
Prompt powered AI for Documents
H2O Label Genie
ETL for GenAI
H2O Document Diff
Document Difference Engine powered by GenAI
Costs of AI
Training
Inference Costs
vLLM
Data
Labeling,
Synthetic
Feedback
Our view on AGI -
The making of the world’s most powerful AI will be
Open Source and community led
Data sanskrit. plural of datum.
to give.
to impact with energy.
mineral rich in energy.
AI will usher in abundance
AI will usher in abundance
abundance of time
abundance of space
outer space, inner space
abundance of matter & energy
With great powers, comes great…
Responsible AI.
Long time ago, there once were -
Virus, Wars and Superstitions
Long time ago, there once were -
Virus, Wars and Fake News
AI can make a difference.
We can make a difference.
AI for Good
AI for Climate Change
AI to Protect WildLife and Pets
AI To Manage Pandemic Supply Chain
AI to Model WildFire Behaviors
AI to Predict Hurricanes
AI for H2O (Water)
AI to Democratize Health
AI to Educate and Upskill our Public Services
Responsible AI and Fairness
AI to predict Hurricanes
AI to fight Climate Change
AI to democratize health
our generation’s revolution.
busy being born and busy dying.
- Bob Dylan
this will be fun!
Gratitude
BC is Before Covid
H2O.ai Confidential
Democratizing
AI for
20,000
Organizations
11OF THE TOP
BANKS
GLOBAL
Partner with H2O.ai
Fortune 1000 / Forbes 2000 Ranked
PROVIDERS /
OTHER
DATA
SERVICES
BUSINESS
BANKS
RETAIL
COMPANIES
CREDIT
H2O.ai Confidential
r
r
r
r
Fortune 1000
Fortune 1000 &
Forbes Global 2000
Fortune 1000,
Fortune Global
500, Forbes
Global 2000
Forbes Global 2000 &
Fortune Global 500
Forbes Global 2000
Fortune Global
500
H2O.ai Confidential
H2O.ai Confidential
r
Fortune 1000
Fortune Global 500
H2O.ai Confidential
r
r
r
r
Fortune 1000
Fortune 1000 &
Forbes Global 2000
Fortune 1000,
Fortune Global
500, Forbes
Global 2000
Forbes Global 2000 &
Fortune Global 500
Forbes Global 2000
Fortune Global
500
Open Source is about freedom, not free!
Raise a forest, not just a tree.
Make ecosystems
purpose needs voice
dream
Make data and AI your first-class assets
Thank You: GenAI Open Source Ecosystem
h2oGPT (Open Source GPTs need RAG)
PyMuPDF
BGE, Instructor embeddings
ragas, evalGPT.ai, hf/leaderboard, llm-eval
hnswlib, Milvus, Chroma
LangChain, LlamaIndex, Open Interpreter
vLLMs, tgi-0.9
HuggingFace, H2O LLMStudio, GGUF, AWQ, Gradio
Alpaca LoRA, llama.cpp, AutoGPTQ, hf/TheBloke
OpenAssistant
LLama2, Falcon, Mistral, GPT3, Eleuther, BigScience
Pytorch, DeepSpeed
“Attention is All You Need” team and Transformers
CUDA, RocM
Python, Go, Rust, K8s, Clouds
# others I might have missed
# @ylecun
# @ Dr. Ebtesam Almazrouei
# @tloen/alpaca-lora @ecjwg
ETL for LLMs
H2O Data Studio
Label Genie powered by LLMs
Hydrogen Torch
Labeling as a Service
Evaluation led LLM Development
evalGPT.ai
ragas, retrieval
Evaluation as a Service
Eval Studio
Costs of AI
Training
Inference Costs
vLLM
Data
Labeling,
Synthetic
Feedback
When Generation is abundant
Curation becomes valuable
AI to curate AI
AI to do AI
customer is the moat.
Co-creation
Gov GenAI App Store
Feature Story
Feature Store
Algorithms
Design
Data
Domain
Business
Applications
Data is a
Team Sport
Teamwork makes the Dream Work
H2O.ai Confidential
KAGGLE
OUR
GrandMasters
UNITED STATES
FRANCE
UNITED
KINGDOM
GERMANY
CZECH REPUBLIC
HUNGARY
AUSTRIA
JAPAN
SINGAPORE
INDIA
TURKEY
Data is the new /* code */
Kaggle LLM Science Exam
Kaggle LLM Science Exam
H2O LLM Studio
H2O Data Studio
Hydrogen Torch
Driverless AI
Document AI
LLMOps and MLOps
RAG + Gen AI Use cases
Customer Experience, Contact Centers
Document Processing
Generating Marketing
Generating Code and Apps
Procurement, RFPs, Contracts, Inventory
Portfolio Recommendation (Earnings Calls)
Custom GPTs
Meeting Summaries, Tumor Board Summary
Multi-modal, Speech
Document Extraction, ETL for LLMs
Labeling, Translation
Ask Data. BI.
H2O.ai Confidential
AI for ALL
AI for Sales People
AI for Investors
AI for Manufacturers
AI for Retailers
AI for Hospitals
AI for Transportation
AI for Urban Planning
AI for Financial Services
AI for Real Estates
AI for Energy
AI for Tourism
AI for Hospitality
AI for Oil and Gas
AI for Nature
AI for Future
AI for Good
Government
Scam Shield
LLM based Scam
Prevention Service
LLM
Governments
Virtual Advisor
LLM based
conversation support
services
LLM
Governments
Blueprint Designer
LLM based design and
construction
LLM
Tourism
Tour Personalization
LLM based travel and
tour recommendations
LLM
Tourism
Language Assist
LLM based multilingual
assistance
LLM
Governments
Waste Management
GenAI based waste
optimization
LLM
Smart City
Dynamic Road Tax
Services to provide
route
recommendations
LLM
Manufacturing
Green Builder
LLMs for Carbon
reduction plans
LLM
Hospitals
Healthcare AI
Best public health
advice using GenAI
LLM
Hospitals
Disease Advice
LLMs for patient care
and disease advice
LLM
Real Estate
Tenancy Screener
LLM for person risk
profiling
LLM
Security
Edge Surveillance
Local LLMs in drones
for Intelligent
Surveillance
LLM
Gen AI App Store - Applications Powered by LLMs
H2O.ai Confidential
AI App Store - Everything AI in one place
AI for ALL
AI for Sales People
AI for Investors
AI for Manufacturers
AI for Retailers
AI for Hospitals
AI for Transportation
AI for Urban Planning
AI for Financial Services
AI for Real Estates
AI for Energy
AI for Tourism
AI for Hospitality
AI for Oil and Gas
AI for Nature
AI for Future
AI for Good
+
Scaling the AI & GenAI for 100s of Use Cases
Data LLMs /
Models
AI + LLM
Apps
GenAI
App Store
Model
Deployments
ATL AI
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
AI Access
Regions
100s of Use Cases
AIaaS Ecosystem with H2O.AI at AT&T
AI Governance
Center
Any AI/ML library
Build your own models
Import
Models
Create App/
Deploy
Model Microservice
● Model Validation
○ Adversarial analysis
○ Backtesting
○ What-if analysis
● Suggest models
○ Model catalog
● Suggest features
○ Feature store
● Ensemble strategies
● Model benchmarking
Create AI
App Store
Model Store
H2O Feature
Store
App Store
Model Analytics Platform
AI Bias eval, MLI
AI Ops
Application
Deploy AI
1
2 3
Self Service Data
Ingestion
H2O - 3
Data Store
on Prem
H2O Olympics
2.5
H2O Olympics
Responsible AI
AI/ML User
Model Store
H2O
WAVE
H2O WAVE
H2O Feature
Store
HDFS
Cloudera
H2O MLOps
Model Repository
Model Deployment
Model Monitoring
High Availability Model Hosting
GenAI (LLMs)
Integration
4
Customer and Community
Love is the greatest force in nature.
From Data Science to Strategy Science
Silence
The quieter you become the more we can hear
Ram Dass
listen
silent
universal
individual
you can do anything you set
your mind to.
eminem.
Courage
H2O.ai Confidential
whose world is this?
https://www.youtube.com/watch?v=ahY62u62Uw8
Transform
manager to a leader
caterpillar to a butterfly!
Rise of Data Scientist
From Data to Strategy Science
CDAO now works closely with CEO
Intelligence is the Edge
Every Company needs to be an AI Company
Every Nation needs to be an AI Nation
The only wisdom we can hope to acquire
Is the wisdom of humility: humility is endless
TS Eliot said that.
You can be in my dream
If I can be in yours.
Bob Dylan said that.
You can be in my selfie
If I can be in yours.
Gratitude
Wish you Well -
this will be fun!
H2O.ai Confidential

More Related Content

Similar to H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day

SIMPosium presentation_Bardess Qlik
SIMPosium presentation_Bardess QlikSIMPosium presentation_Bardess Qlik
SIMPosium presentation_Bardess Qlik
Bardess Group
 
The best of both worlds - Alfresco, Liferay and CIGNEX event
The best of both worlds - Alfresco, Liferay and CIGNEX eventThe best of both worlds - Alfresco, Liferay and CIGNEX event
The best of both worlds - Alfresco, Liferay and CIGNEX event
Alfresco Software
 
Osgis2011 edina addy_pope
Osgis2011 edina addy_popeOsgis2011 edina addy_pope
Osgis2011 edina addy_pope
Addy Pope
 

Similar to H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day (20)

Keynote at the MTSR conference
Keynote at the MTSR conferenceKeynote at the MTSR conference
Keynote at the MTSR conference
 
Automatic and Interpretable Machine Learning in R with H2O and LIME
Automatic and Interpretable Machine Learning in R with H2O and LIMEAutomatic and Interpretable Machine Learning in R with H2O and LIME
Automatic and Interpretable Machine Learning in R with H2O and LIME
 
Automatic and Interpretable Machine Learning in R with H2O and LIME
Automatic and Interpretable Machine Learning in R with H2O and LIMEAutomatic and Interpretable Machine Learning in R with H2O and LIME
Automatic and Interpretable Machine Learning in R with H2O and LIME
 
Apidays Singapore 2024 - A nuanced approach on AI costs and benefits for the ...
Apidays Singapore 2024 - A nuanced approach on AI costs and benefits for the ...Apidays Singapore 2024 - A nuanced approach on AI costs and benefits for the ...
Apidays Singapore 2024 - A nuanced approach on AI costs and benefits for the ...
 
Revolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus ExampleRevolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus Example
 
SIMPosium presentation_Bardess Qlik
SIMPosium presentation_Bardess QlikSIMPosium presentation_Bardess Qlik
SIMPosium presentation_Bardess Qlik
 
Building Resiliency and Agility with Data Virtualization for the New Normal
Building Resiliency and Agility with Data Virtualization for the New NormalBuilding Resiliency and Agility with Data Virtualization for the New Normal
Building Resiliency and Agility with Data Virtualization for the New Normal
 
Introducción al Aprendizaje Automatico con H2O-3 (1)
Introducción al Aprendizaje Automatico con H2O-3 (1)Introducción al Aprendizaje Automatico con H2O-3 (1)
Introducción al Aprendizaje Automatico con H2O-3 (1)
 
Top 10 renowned big data companies
Top 10 renowned big data companiesTop 10 renowned big data companies
Top 10 renowned big data companies
 
Agile Network India | Industry 4.0 - Digital Agility Vade Mecum | Atul Jadhav
Agile Network India | Industry 4.0 - Digital Agility Vade Mecum | Atul JadhavAgile Network India | Industry 4.0 - Digital Agility Vade Mecum | Atul Jadhav
Agile Network India | Industry 4.0 - Digital Agility Vade Mecum | Atul Jadhav
 
Honeypotz inc company deck
Honeypotz inc company deckHoneypotz inc company deck
Honeypotz inc company deck
 
Combining Causal and Knowledge Modeling for Digital Transformation
Combining Causal and Knowledge Modeling for Digital TransformationCombining Causal and Knowledge Modeling for Digital Transformation
Combining Causal and Knowledge Modeling for Digital Transformation
 
ISV Showcase: End-to-end Machine Learning using H2O on Azure
ISV Showcase: End-to-end Machine Learning using H2O on AzureISV Showcase: End-to-end Machine Learning using H2O on Azure
ISV Showcase: End-to-end Machine Learning using H2O on Azure
 
Greetings david cutler inform and connect
Greetings   david cutler inform and connectGreetings   david cutler inform and connect
Greetings david cutler inform and connect
 
Modern Thinking área digital MSKM 21/09/2017
Modern Thinking área digital MSKM 21/09/2017Modern Thinking área digital MSKM 21/09/2017
Modern Thinking área digital MSKM 21/09/2017
 
The best of both worlds - Alfresco, Liferay and CIGNEX event
The best of both worlds - Alfresco, Liferay and CIGNEX eventThe best of both worlds - Alfresco, Liferay and CIGNEX event
The best of both worlds - Alfresco, Liferay and CIGNEX event
 
Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...
 
Greetings david cutler inform and connect
Greetings   david cutler inform and connectGreetings   david cutler inform and connect
Greetings david cutler inform and connect
 
Osgis2011 edina addy_pope
Osgis2011 edina addy_popeOsgis2011 edina addy_pope
Osgis2011 edina addy_pope
 
Osgis2011 edina addy_pope
Osgis2011 edina addy_popeOsgis2011 edina addy_pope
Osgis2011 edina addy_pope
 

More from Sri Ambati

More from Sri Ambati (20)

Generative AI Masterclass - Model Risk Management.pptx
Generative AI Masterclass - Model Risk Management.pptxGenerative AI Masterclass - Model Risk Management.pptx
Generative AI Masterclass - Model Risk Management.pptx
 
AI and the Future of Software Development: A Sneak Peek
AI and the Future of Software Development: A Sneak Peek AI and the Future of Software Development: A Sneak Peek
AI and the Future of Software Development: A Sneak Peek
 
LLMOps: Match report from the top of the 5th
LLMOps: Match report from the top of the 5thLLMOps: Match report from the top of the 5th
LLMOps: Match report from the top of the 5th
 
Building, Evaluating, and Optimizing your RAG App for Production
Building, Evaluating, and Optimizing your RAG App for ProductionBuilding, Evaluating, and Optimizing your RAG App for Production
Building, Evaluating, and Optimizing your RAG App for Production
 
Building LLM Solutions using Open Source and Closed Source Solutions in Coher...
Building LLM Solutions using Open Source and Closed Source Solutions in Coher...Building LLM Solutions using Open Source and Closed Source Solutions in Coher...
Building LLM Solutions using Open Source and Closed Source Solutions in Coher...
 
Risk Management for LLMs
Risk Management for LLMsRisk Management for LLMs
Risk Management for LLMs
 
Open-Source AI: Community is the Way
Open-Source AI: Community is the WayOpen-Source AI: Community is the Way
Open-Source AI: Community is the Way
 
Building Custom GenAI Apps at H2O
Building Custom GenAI Apps at H2OBuilding Custom GenAI Apps at H2O
Building Custom GenAI Apps at H2O
 
Applied Gen AI for the Finance Vertical
Applied Gen AI for the Finance Vertical Applied Gen AI for the Finance Vertical
Applied Gen AI for the Finance Vertical
 
Cutting Edge Tricks from LLM Papers
Cutting Edge Tricks from LLM PapersCutting Edge Tricks from LLM Papers
Cutting Edge Tricks from LLM Papers
 
Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...
Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...
Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...
 
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
 
KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...
KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...
KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...
 
LLM Interpretability
LLM Interpretability LLM Interpretability
LLM Interpretability
 
Never Reply to an Email Again
Never Reply to an Email AgainNever Reply to an Email Again
Never Reply to an Email Again
 
From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...
From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...
From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...
 
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
 
AI Foundations Course Module 1 - An AI Transformation Journey
AI Foundations Course Module 1 - An AI Transformation JourneyAI Foundations Course Module 1 - An AI Transformation Journey
AI Foundations Course Module 1 - An AI Transformation Journey
 
ML Model Deployment and Scoring on the Edge with Automatic ML & DF
ML Model Deployment and Scoring on the Edge with Automatic ML & DFML Model Deployment and Scoring on the Edge with Automatic ML & DF
ML Model Deployment and Scoring on the Edge with Automatic ML & DF
 
Scaling & Managing Production Deployments with H2O ModelOps
Scaling & Managing Production Deployments with H2O ModelOpsScaling & Managing Production Deployments with H2O ModelOps
Scaling & Managing Production Deployments with H2O ModelOps
 

Recently uploaded

Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
Wonjun Hwang
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 

Recently uploaded (20)

Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 

H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day

  • 1. H2O.ai Confidential Democratize AI with H2O.ai 8 7 222OF THE H2O OF THE TOP 10 BANKS OF THE TOP 10 4 OF THE TOP 10 MANUFACTURING COMPANIES INSURANCE COMPANIES FORTUNE 500 CUSTOMER OBSESSION MAKER CULTURE Commonwealth Bank, Goldman Sachs, Wells Fargo, NVIDIA, Capital One, Nexus Ventures, New York Life 2M Community 30 Kaggle Grandmasters 2012 FOUNDED IN SILICON VALLEY $256M FUNDRAISED, SUSTAINABLE
  • 2. Open Source is freedom, not free!
  • 5. H2O.ai Confidential H2O.ai Confidential H2O products are backed by 10% of the World’s Data Science Grandmasters and a Team of Experts who are relentless in solving critical problems. KAGGLE GRANDMASTERS World’s Best Data Scientists 2 Quadruple GMs 1 Triple GM 7 Double GMs #1 KGM #3 KGM 5 Top 10 Globally 10 Kaggle Masters H2O.ai KGM HIGHLIGHTS ● 2023 H2O KGMs win 3 healthcare-related competitions ● July 2023 H2O KGMs make “Top GenAI Scientists” list ● Oct 2023 H2O paper accepted at EMNLP 2023 ● Nov 2023 H2O KGMs win 1st place in Kaggle Science Exam competition ● Jan 2024 H2O KGM places 2nd in Detect AI Text competition ● Feb 2024 introduced foundational model H2O-Danube 1.8b
  • 7. H2O.ai Confidential Generative AI Predictive AI Generative AI AWARD-WINNING AUTOML reaches a new audience with chat & function calling assistants for ML Enhanced AI for Documents Automation for data labeling Automation of code for AI Apps CUSTOMGPTS: H2O foundational models, fine-tuned models, personality, on top of predictive models Convergence of World’s best Predictive and Generative AI GenAI Apps Enterprise h2oGPTe: Python APIs and UI for chat, RAG customGPTs Function-calling & Agents Prompt Tuning Foundational Models document and data labeling on-premise, air-gapped, cloud VPC | SaaS +
  • 8. H2O.ai Confidential GenAI AppStudio Structured Datasets Unstructured Datasets ETL / Prep for LLMs Documents → QA Pairs Fine Tuning LLMs (& Prompts) End Users Vector DB (Embeddings ) myGPT R. A. G. Talk to your Data Document QA Document Chat Image/Video Chat LLM Query GenAI Apps + + + + + + LLM Data Studio AI Engines MLOps EvalStudio AI Apps + LLMs Integration LLMOps API Prompt Studio Continuous Feedback Parsing . Chunking Indexing . Embeddings LLM Agents Chat / QA Prompt Engineering LLM Workers Enterprise h2oGPTe (RAG) Make Your Own Eval Predictive AI Layer Predictive + Gen AI h2o-functions World’s Best AI to do Gen AI Tabular Data
  • 9. Raise a forest, not just a tree. Make ecosystems
  • 10. H2O.ai Confidential Hyperscalers Technology VARs/ Distributors Successful Partnerships Reduce complexity of the sales process through Marketplace. Collaborative sales strategy. Co-sell and integration to accelerate inferencing on end-to-end workflows. Gain business agility with faster time to market Simplified procurement process, flexible terms, simplified deployment. Seamless integration with cloud providers solutions. Flexible deployment options, Breakthrough cost reduction and ROI. Secure, data never leaves the environment Access to expertise, custom solutions, and seamless integration, reducing the pain and time of ML/Gen AI adoption Strategic Fit Customer Value Industry Co-create GenAI solutions related to various industry specific problem statements Faster time to market, rapid innovation and developing cutting-edge GenAI offerings Public Sector Expansion into new agencies Access to enterprise ready solutions
  • 11. Tech Ecosystem of H2O GenAI OPEN SOURCE MODELS VECTOR DATABASES CLOSE SOURCE MODELS LLM INFERENCING HARDWARE MODEL HOSTING CLOUD PROVIDERS
  • 12. Thank you, Community. Gratitude. Makers, past, present and future! H2O Movement Community and Customers! To all greatness, our greetings endaro mahanubhavulu
  • 13. Data Scientist = 100% data Business Unit = 85% data, 15% storytelling Executive = 15% data, 85% storytelling Board = 99% storytelling GrandPa = 100% storytelling
  • 14. Prompt is your intellectual property
  • 16. Every Nation needs to be an AI Nation
  • 17. Private On-prem, behind your firewall Sovereign Data Sovereign AI
  • 18. H2O.ai Confidential Documents Data Sources LLM DataStudio myGPT LLM EvalStudio Vector DB (Embeddings) Alternative Datasets Query + Documents (Context) Talk to Your Data Ques Answers Context Search Doc Retrieval Similar Doc Personalization Contextual Similarity Continuous Eval (feedback) GenAI App Store End User + + + + + + Data AI Engines AI Apps LLM Integration Models Data to QA pairs ETL for LLMs LLM Fine Tuning Custom GPT API Embeddings DataStore The Whole Ecosystem of AI with GenAI to deliver Impact LLMOps Prompt Studio
  • 19. Time is the only non-renewable resource
  • 20.
  • 21. Open Source Foundation Models H2O Danube 2 LLM 1.8B, 2T Tokens, 4K seq length fp8 precision during training (quantization) Grouped Query Attention (Dropped Windowing; Mistral Tokenizer) Compute 7,600 GPU hrs, (8xH100, 45 days) Inference is efficient. Embeddable. Cost efficient! (lot less than you think!) Ready to pre-train on your data! Democratizing Foundation LLMs
  • 22.
  • 23. Using LLM Studio DPO, with good chat data Fine-Tuned for Chat
  • 24. Open Source h2oGPT Fine-tuning and RAG of Best-in-class Open Source LLMs Open Source H2O LLM Studio Best-in-class Studio to fine-tune LLMs
  • 25. Enterprise h2oGPTe Best-in class RAG and API to power GenAI Apps
  • 26. H2O EvalStudio Evaluation-led building of LLM-powered Applications Open Source H2O EvalGPT Evaluate LLMs for public and private benchmarks
  • 27. LLM-Based Evaluation Prompt/Context and Document Embedding Dimensionality Reduction and Clustering Cluster/Topic Summarization Auto Prompt Generation Prompt Perturbation • Invariance • Adversarial Robustness • Performance Drop Stratified Sampling Weakness Detection • Weak clusters/topics Resilience • Performance under distribution shift Interpretability Outcome Analysis: Cluster Eval Input-Output Visualization Diagnostics
  • 28. Converging Predictive AI and Generative AI
  • 29. H2O Agents Converging Predictive AI and Generative AI
  • 30. H2O Document AI Prompt powered AI for Documents
  • 31. H2O Label Genie ETL for GenAI
  • 32. H2O Document Diff Document Difference Engine powered by GenAI
  • 33. Costs of AI Training Inference Costs vLLM Data Labeling, Synthetic Feedback
  • 34. Our view on AGI - The making of the world’s most powerful AI will be Open Source and community led
  • 35. Data sanskrit. plural of datum. to give. to impact with energy. mineral rich in energy.
  • 36. AI will usher in abundance
  • 37. AI will usher in abundance abundance of time abundance of space outer space, inner space abundance of matter & energy
  • 38. With great powers, comes great… Responsible AI.
  • 39. Long time ago, there once were - Virus, Wars and Superstitions
  • 40. Long time ago, there once were - Virus, Wars and Fake News
  • 41. AI can make a difference.
  • 42. We can make a difference.
  • 43. AI for Good AI for Climate Change AI to Protect WildLife and Pets AI To Manage Pandemic Supply Chain AI to Model WildFire Behaviors AI to Predict Hurricanes AI for H2O (Water) AI to Democratize Health AI to Educate and Upskill our Public Services Responsible AI and Fairness
  • 44.
  • 45. AI to predict Hurricanes
  • 46. AI to fight Climate Change
  • 49. busy being born and busy dying. - Bob Dylan
  • 50. this will be fun!
  • 52. BC is Before Covid
  • 53. H2O.ai Confidential Democratizing AI for 20,000 Organizations 11OF THE TOP BANKS GLOBAL Partner with H2O.ai Fortune 1000 / Forbes 2000 Ranked PROVIDERS / OTHER DATA SERVICES BUSINESS BANKS RETAIL COMPANIES CREDIT
  • 54. H2O.ai Confidential r r r r Fortune 1000 Fortune 1000 & Forbes Global 2000 Fortune 1000, Fortune Global 500, Forbes Global 2000 Forbes Global 2000 & Fortune Global 500 Forbes Global 2000 Fortune Global 500
  • 58. H2O.ai Confidential r r r r Fortune 1000 Fortune 1000 & Forbes Global 2000 Fortune 1000, Fortune Global 500, Forbes Global 2000 Forbes Global 2000 & Fortune Global 500 Forbes Global 2000 Fortune Global 500
  • 59. Open Source is about freedom, not free!
  • 60. Raise a forest, not just a tree. Make ecosystems
  • 62. dream
  • 63. Make data and AI your first-class assets
  • 64. Thank You: GenAI Open Source Ecosystem h2oGPT (Open Source GPTs need RAG) PyMuPDF BGE, Instructor embeddings ragas, evalGPT.ai, hf/leaderboard, llm-eval hnswlib, Milvus, Chroma LangChain, LlamaIndex, Open Interpreter vLLMs, tgi-0.9 HuggingFace, H2O LLMStudio, GGUF, AWQ, Gradio Alpaca LoRA, llama.cpp, AutoGPTQ, hf/TheBloke OpenAssistant LLama2, Falcon, Mistral, GPT3, Eleuther, BigScience Pytorch, DeepSpeed “Attention is All You Need” team and Transformers CUDA, RocM Python, Go, Rust, K8s, Clouds # others I might have missed # @ylecun # @ Dr. Ebtesam Almazrouei # @tloen/alpaca-lora @ecjwg
  • 65. ETL for LLMs H2O Data Studio Label Genie powered by LLMs Hydrogen Torch Labeling as a Service
  • 66. Evaluation led LLM Development evalGPT.ai ragas, retrieval Evaluation as a Service Eval Studio
  • 67. Costs of AI Training Inference Costs vLLM Data Labeling, Synthetic Feedback
  • 68. When Generation is abundant Curation becomes valuable
  • 70. AI to do AI
  • 73. Gov GenAI App Store
  • 77. Data is the new /* code */
  • 79. Kaggle LLM Science Exam H2O LLM Studio H2O Data Studio Hydrogen Torch Driverless AI Document AI LLMOps and MLOps
  • 80. RAG + Gen AI Use cases Customer Experience, Contact Centers Document Processing Generating Marketing Generating Code and Apps Procurement, RFPs, Contracts, Inventory Portfolio Recommendation (Earnings Calls) Custom GPTs Meeting Summaries, Tumor Board Summary Multi-modal, Speech Document Extraction, ETL for LLMs Labeling, Translation Ask Data. BI.
  • 81. H2O.ai Confidential AI for ALL AI for Sales People AI for Investors AI for Manufacturers AI for Retailers AI for Hospitals AI for Transportation AI for Urban Planning AI for Financial Services AI for Real Estates AI for Energy AI for Tourism AI for Hospitality AI for Oil and Gas AI for Nature AI for Future AI for Good Government Scam Shield LLM based Scam Prevention Service LLM Governments Virtual Advisor LLM based conversation support services LLM Governments Blueprint Designer LLM based design and construction LLM Tourism Tour Personalization LLM based travel and tour recommendations LLM Tourism Language Assist LLM based multilingual assistance LLM Governments Waste Management GenAI based waste optimization LLM Smart City Dynamic Road Tax Services to provide route recommendations LLM Manufacturing Green Builder LLMs for Carbon reduction plans LLM Hospitals Healthcare AI Best public health advice using GenAI LLM Hospitals Disease Advice LLMs for patient care and disease advice LLM Real Estate Tenancy Screener LLM for person risk profiling LLM Security Edge Surveillance Local LLMs in drones for Intelligent Surveillance LLM Gen AI App Store - Applications Powered by LLMs
  • 82. H2O.ai Confidential AI App Store - Everything AI in one place AI for ALL AI for Sales People AI for Investors AI for Manufacturers AI for Retailers AI for Hospitals AI for Transportation AI for Urban Planning AI for Financial Services AI for Real Estates AI for Energy AI for Tourism AI for Hospitality AI for Oil and Gas AI for Nature AI for Future AI for Good
  • 83. + Scaling the AI & GenAI for 100s of Use Cases Data LLMs / Models AI + LLM Apps GenAI App Store Model Deployments ATL AI + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + AI Access Regions 100s of Use Cases
  • 84. AIaaS Ecosystem with H2O.AI at AT&T AI Governance Center Any AI/ML library Build your own models Import Models Create App/ Deploy Model Microservice ● Model Validation ○ Adversarial analysis ○ Backtesting ○ What-if analysis ● Suggest models ○ Model catalog ● Suggest features ○ Feature store ● Ensemble strategies ● Model benchmarking Create AI App Store Model Store H2O Feature Store App Store Model Analytics Platform AI Bias eval, MLI AI Ops Application Deploy AI 1 2 3 Self Service Data Ingestion H2O - 3 Data Store on Prem H2O Olympics 2.5 H2O Olympics Responsible AI AI/ML User Model Store H2O WAVE H2O WAVE H2O Feature Store HDFS Cloudera H2O MLOps Model Repository Model Deployment Model Monitoring High Availability Model Hosting GenAI (LLMs) Integration 4
  • 85. Customer and Community Love is the greatest force in nature.
  • 86. From Data Science to Strategy Science
  • 87. Silence The quieter you become the more we can hear Ram Dass
  • 89.
  • 91. you can do anything you set your mind to. eminem.
  • 95. Rise of Data Scientist From Data to Strategy Science CDAO now works closely with CEO
  • 97. Every Company needs to be an AI Company
  • 98. Every Nation needs to be an AI Nation
  • 99. The only wisdom we can hope to acquire Is the wisdom of humility: humility is endless TS Eliot said that.
  • 100. You can be in my dream If I can be in yours. Bob Dylan said that.
  • 101. You can be in my selfie If I can be in yours.
  • 103. this will be fun!