This document provides an overview of Google's generative AI offerings. It discusses large language models (LLMs) and what is possible with generative AI on Google Cloud, including Google's offerings like Vertex AI, Generative AI App Builder, and Foundation Models. It also discusses how enterprises can access, customize and deploy large models through Google Cloud to build innovative applications.

1. Proprietary + Confidential
Cloud AI GenAI Overview
Partner Tech Series

2. Proprietary + Confidential
Table of Contents
Primer on LLM and Generative AI
What is possible with Generative AI on
Google Cloud?
01
02
What are Google’s offerings?
Enterprise readiness
03
04
05
Why Google and next steps

3. Proprietary + Confidential
PRIMER ON LARGE
LANGUAGE MODELS &
GENERATIVE AI

4. Proprietary + Confidential
We’re in an AI-driven revolution
Source: AI: Recent Trends and Applications, Emerging Communication and Computing
Steam Power
1784
Electricity
1870
Information
Technology
1969
Artificial Intelligence
Today
AI

5. Proprietary + Confidential
What are large language models?
ML algorithms that can recognize, predict, and
generate human languages
Pre-trained on petabyte scale text-based datasets
resulting in large models with 10s to 100s of
billions of parameters
LLMs are normally pre-trained on a large corpus
of text followed by fine-tuning on a specific task
Proprietary + Confidential
Go read this huuuuuuge pile
of books.
So, you’ve learned about
cats and millions of other
concepts … what’s a cat?
A cat is a small, domesticated
carnivorous mammal.
Generative language models
LaMDA, PaLM, GPT-3, etc.
LLMs can also be called Large Models (includes all
types of data modality) and Generative AI (a
model that produces content)

6. Proprietary + Confidential
Why are large language models
different?
LLMs are characterized by emergent
abilities, or the ability to perform tasks that
were not included in their training
examples.
LLMs contextual understanding of human
language changes how we interact with
data and intelligent systems.
LLMs can find patterns and connections in
massive, disparate data corpora.
Proprietary + Confidential
Search
Conversation
Content generation

7. Proprietary + Confidential
This revolution started at Google and we continue to innovate
Transformers
● Pathbreaking Neural Network
Architecture
● Open Sourced by Google in
2017
● Started the revolution in
Language Models
T5
(Text-to-Text Transfer Transformer)
● Large Language Encoder-
Decoder Model
● 10-billion parameter model
● Open Sourced by Google in
2019
Diffusion Models
● High Fidelity Image Generation
Using Diffusion Models
PaLM
● (Pathways Language Model)
● Single model to generalize
across domains
● 540-billion parameter, dense
decoder model
BERT
(Bidirectional Encoder
Representations from Transformers)
● World’s first Language Model
● Open Sourced by Google in
2018
● SOTA on number of language
benchmarks
LaMDA
(Language Model for Dialog
Applications)
● Model trained on dialogue data
● Model could talk about virtually
anything
● Published by Google in 2020
CALM
(Confident Adaptive Language
Modeling)
● Accelerating the text generation
of LMs
2017 2018 2019 2020 2021 2022 2023
Bard
● A conversational AI service
powered by LaMDA.
Vertex Gen AI
● Generative AI App Builder:
Conversation AI, Enterprise
Search, Foundation Models
● Vertex AI: Gen AI Studio, Gen AI
APIs, Model Garden

8. Proprietary + Confidential
WHAT IS POSSIBLE WITH
GENERATIVE AI ON
GOOGLE CLOUD?

9. Proprietary + Confidential
Generative AI is driving new opportunities
Operational efficiencies, cost savings, and value creation
Improve time-to-value to
search, navigate, and
extract insights and
understanding from large
amounts of complex data
Complex data,
intuitively accessible
Improve customer
experience, reaching larger
client bases by making
online interactions more
natural, conversational, and
rewarding
Online interactions
made conversational
Generate text, code, image,
video, or music quickly and
multi-modally, speeding up
every business process and
maximizing employee
productivity
Content generation at
the click of a button
Customize large models
and incorporate state of the
art generative capabilities
natively into your own
internal ML operational
platforms
Customize
Foundational models
Analyst
Customer
Service
Creative
AI
Practitioner

10. Public Website
Navigation
Effectively find
information from a
website via multi-
modal inputs and
conversational
queries
Customer Service
Automation
Effectively service
customers requests
for information and
service provisioning
Product / Content
Catalog
Discovery
Effectively find the
most relevant
Products / Content
listings from a
inventory catalogue
Product / Content
Recommendation
Recommend
personalized Product
/ Content / Next Best
Action from a
catalogue
Intra-Knowledge
Q & A
Conversationally
query questions for
answers from internal
knowledge sources
Document Search
& Synthesis
Effectively find the
most relevant
documents and
summarize their
contents
Business Process
Automation
Automating the
information retrieval
and recommendation
step of a recurring
business process
Creative
Assistance
Empower creative
teams to create
bespoke images and
creative content for
campaigns and
editorial content
Regulatory
Compliance
Automation
Interpret regulatory
policy / documents to
identify potential
violations relative to
operating
procedures
Research
Acceleration
Find complex subject
domain information
across many
disparate sources
and synthesis the
findings
Documentation
Generation
Write new
documentation
based on
summarization of
other documents &
software code
Developer
Efficiency
Complete and
augment code to
make your
engineering team
more efficient and
effective
Complex data, intuitively accessible Online interactions made conversational
Content generation at the click of a
button
Enterprises are realizing significant value
From top Generative AI powered use cases

11. Proprietary + Confidential
WHAT ARE GOOGLE’S
OFFERINGS?

12. Proprietary + Confidential
Consumers & enterprises have different needs….
Consumers and enthusiasts
Bard, MakerSuite
● Help me plan a neighborhood block party
● Outline my blog post about summer mocktail recipes
● I want to write a novel. How do I get started?
● Draft a packing list for my weekend fishing and camping trip
● Give me a list of idioms for “let’s circle back” that aren’t cringe
● Help me name my first EP
Enterprise Customers
Vertex AI
● Allow data analysts to search and summarize market reports
while controlling our data
● Help my customers understand my financial products while
being safe, explainable, and regulatory compliant
● Is it easy to integrate into our existing apps and platform?
● Handle a customer service interaction with accurate info
● Can you guarantee we have access to
state-of-the-art models?
● Can we generate content while controlling costs?

13. Proprietary + Confidential
Generative AI: Offerings Overview
Generative AI support in Vertex AI
Generative AI APIs, end to end support from
serving to tuning of foundation models
● Generative AI APIs across multiple modalities
● Model Garden and Generative AI Studio
● Prompt design and prompt tuning
● Fine tuning of foundation models
● Foundation model support for training, prediction and MLOps
Generative AI App Builder
Fast application development leveraging the
power of search, immersive conversational
experiences, and foundation models with
enterprise controls
Search
● Google-quality out-of-
box search
● Tuneable
● Multimodal
● Conversational
Conversation
● Single turn
● Multi turn
● Information seeking
● Transactional
● Flow control

14. Proprietary + Confidential
Cloud AI Portfolio
To support the needs of Generative AI centric enterprise development
Vertex AI
Contact Center AI Document AI Discovery AI Healthcare AI
Conversation AI
Enterprise Search
Foundation
Models
Generative AI
App Builder
End-to-End ML Platform
Google Cloud Infrastructure
Generative AI Studio | Generative AI APIs | Model Garden
Business users
Developers
AI Practitioners

15. Proprietary + Confidential
Reimagine
conversational
experiences with Gen
App Builder
When online interactions
become more
conversational and human-
like, it creates an
opportunity for enterprises
to better connect with
customers, employees and
partners. Let’s look at how
generative AI can transform
the customer experience.

16. Proprietary + Confidential
Supercharging Contact Center AI with conversational AI
Virtual Agents
Today: 24/7 customer self-service
● conversational voice/chat bots with
LLMs used in speech models
● integrated handoffs to live agents
Tomorrow: better bots faster & easier
● out of the box infobot, grounded in
your content, supercharged with
LLMs
● simple to build transaction bots,
describe the task using natural
language or drag & drop prebuilt use
cases
● simple business logic graph with
conversation transitions handled by
AI
Agent Assist
Today: Empower live agents with step-
by-step help during calls/chats and
automated summary of every
interaction
Tomorrow: Virtual agents give on-
demand help to live agents. FAQs
automatically generated based on live
agent to customer interactions.
Insights
Today: understand how to improve
virtual and live agent outcomes through
natural language processing that
identifies call drivers, popular questions,
and more
Tomorrow: continuous customer
experience improvement with a
flywheel that creates FAQs and
improves bots automatically
Contact Center AI Platform
Today: End-end, AI-first contact center as a service
Tomorrow: AI-powered capability providing value on Day 1 - NLU
powered call/chat steering, out-of-box infobot virtual agent, Insight
on unstructured data, LLM-driven call/chat summarization
Conversationa
l
core
Insights
Virtual agent Agent assist

17. Proprietary + Confidential
Proprietary + Confidential
Conversational AI
Harness the power of Generative AI to build next-generation conversational experiences in minutes
OOTB enterprise
chatbot experience,
grounded on your data
and supercharged w/
LLM
Generate bots that answer
even complex end user
questions by leveraging
company data and the
intelligence of the web, all
while keeping data private
Easily add transaction
capabilities
Leverage pre-built flows or
easily build your own by
describing the task using
natural language to have
bots complete transactions
like checking order status,
appointment booking, and
more.
Publish across channels
Surface the bot on your
website, in popular
messaging apps, and
connect with telephony
providers in a couple of
clicks.
Voice calls have the option
to enable ultra-realistic voice
and speech interactions.
Next-gen end user
experience
Bots understand complex
language and can surface
the best answer based on
the question and user type.
You control whether
answers from the web are
used and what topics are off
limits.

18. Proprietary + Confidential
Make data more
accessible and useful
with Gen App Builder
Many organizations have
huge knowledge bases, and
want to leverage generative
AI capabilities for fast,
effective Q&A with their
data. Let’s take a look at
how generative AI can make
complex data more
accessible, and more useful.

19. Proprietary + Confidential
Enterprise Search
Developers
No ML skill required
AI Practitioners
Advanced ML skill
OOTB search
Google-quality out-of-the-box search
experience for implementers
Fast and easy setup for
Application Developers
Tuneable, multimodal, &
conversational search
“Tune the OOTB” search
Customization for
Search Developers
Build your own search
“Build your own” search with advanced
ML/AI
Model training/ tuning for
AI/ML Engineers

20. Proprietary + Confidential
Google Cloud makes it
easy to access, customize,
and deploy large models -
opening the door for a
new-era of applications
that can create,
recommend,
troubleshoot, synthesize,
analyze and engage in a
natural way.
Build, tune, and
deploy foundation
models with Vertex AI

21. Proprietary + Confidential
Foundation Models
Across a variety of model sizes to address use cases
Understand and generate natural
language
Examples: Summarize an analyst report,
write a blog post
Text
Understand, generate, and auto-
complete code
Examples: Write SQL code to complete a
data analysis task, Finish this python
function
Code
Generate, edit, and understand images
Examples: Ad campaigns with AI-generated
visuals, image for website
Image
Understand and generate spoken
conversations.
Examples: 24x7 customer service chatbot,
virtual assistant
Dialogue
Understand and generate audio and
music.
Examples: Music for Youtube video,
synthetic speaker for news broadcast
Audio and Music Roadmap
Generate, edit, and understand videos
Examples: Digital avatar, cutscene in a video
game
Video Roadmap
Choice: Wide range of model sizes to ensure best price performance for a given app
Safety: Immediately leverage the built-in best practices, data governance, and tooling from Google Cloud AI
Innovation: Enjoy the state-of-the-art models commercialized from Google Research and Deepmind
Enterprise-ready: Built on Google infrastructure – high performance and scalability, low cost, global reach
And more models to
come in the future …

22. Proprietary + Confidential
One stop shop to discover and test-drive large foundation
models, task-specific solutions, and open source models,
all with GCP’s enterprise MLOps tooling built in.
Use FM directly for many use cases
with pre-built templates.
Tune FM with data & prompts for
targeted industry or use cases.
Customize popular open source
models via Data Science Notebooks
and Vertex AI Pipelines
API access to task-specific solutions
across language, vision, speech,
document AI, and other modalities
Vertex AI Model Garden
One place to launch various enterprise user journeys

23. Proprietary + Confidential
Large Model API
GCP Governance /
Compliance
GCP Billing
Parameter
Efficient Tuning
Inference
Text Model
UI
Responsible AI
External Customer Creative Generator
Internal Customer
Fine Tuning
Library of foundational models
Distillation
Enterprise compliance
and readiness
Customize and optimize
Dialogue Model Image Model Speech Model
Vertex AI removes the complexity of serving and tuning foundation models

24. Proprietary + Confidential
Announcing - Public Preview on Vertex AI
Generative AI Studio
Interact with, tune, and deploy foundation models
For creators (UI), app developers (API), and AI practitioners (fine-tuning)
A simple UI for interacting with models
Chat interface to interact with models
Prompt gallery to explore sample use cases
Prompt design to tune models
Tune models with your own data
A variety of tuning methods including tuning with simple
text prompts, fine-tuning, and tuning with human feedback
(RLHF).
Use models in production
Embed into applications by quickly generating and
customizing API code
Multiple modalities
APIs available for Text, Image, Code, and Speech
Preview

25. Custom language tasks in a few sentences
Zero/few-shot prompting with a gallery of pre-built prompts
Multi-purpose & versatile chat functionality
In-browser assistant to ask questions, summarize text, brainstorm
ideas, & much more
Multi-Turn Conversations w/ Preserved Context for Chat
Have long conversations passing context throughout the session
Customize on your data
Task-specific tuning on user’s custom data
Ready for enterprise use
Your data is never shared and models outputs are checked across 16
safety attributes like hate speech, toxicity, violence, sexual, insults,
obscenity, weapons, etc.
Preview
Use Cases: Classification, sentiment analysis,
entity extraction, extractive question answering,
summarization, text rewrite in different style, ad
copy generation, concept ideation, dialog,
chatbots
Announcing - Public Preview on Vertex AI
PaLM for Text and Chat
Access and customize multi-turn use cases such as content generation and chat

26. Proprietary + Confidential
Generate Images
Generative images at scale with low latency and high
quality results. Upload your own data and generate
images with your products or logos.
Edit Images
Customize and adapt to your specifications with
capabilities like mask-free edit, and upscaling
Caption & Classify Images
Craft the perfect description and accurately label your
content
Ready for enterprise-use
Generative images at scale with built-in content
moderation. Images generated are the property of the
user and safe for enterprise use
TTP
Announcing - Private Preview on Vertex AI
Imagen for Text-to-Image
Generate and edit high quality images with simple text prompts
Use Cases: Prototyping, marketing, avatars, ads

27. Proprietary + Confidential
Customize Codey with your own codebase
Tune the Codey model with your own codebase and
embed into applications
Code Completion and Generation
Low latency code assistance that can provide current
line and the next few lines of code and generate code
from natural language descriptions
Multi-tune code chatbot
Ask a coding bot for assistance with your coding
questions
Data privacy + recitation checks
Your code will never be shared with Google or others.
Built-in recitation checks help identify the sources used
in your code models.
TTP
Announcing - Private Preview on Vertex AI
Codey for Text-to-Code
Accelerate software development with real-time code completion and generation, customized to your own
codebase
Use Cases: Text-to-Code tuned with your own
codebase, improve developer velocity,
troubleshoot and debug, and improve code
quality

28. Proprietary + Confidential
Preview
Announcing - Public Preview on Vertex AI
Chirp for Speech to Text
Build voice-enabled applications for global audiences
Apply the power of large models to Speech
Self supervised training on millions of hours of audio to
create the first 2B parameter speech model.
Improve speech recognition quality
Achieves 98% accuracy on English and over 300%
relative improvement in tail languages. Bringing the
quality of all the world’s languages closer to that of
widely spoken languages.
Unlock speech use cases and languages
From captioning of Punjabi videos to Balinese voice
assistance, users can now build conversational
experiences in any language.
Use Cases: Captioning videos, voice assistants

29. Proprietary + Confidential
Improve model performance by making it
mode adaptable to user’s needs
RLHF uses human feedback as a reward
signal to guide the model towards generating
high-quality language outputs. With a diverse
set of feedback, RLHF can make more
versatile and useful in a variety of contexts.
Improve pre-trained LLM without increasing
the model size
RLHF tuned models are typically more
accurate and reliable compared to other
training methods without getting larger in
size.
Announcing - Private Preview on Vertex AI
Reinforcement learning from human feedback (RLHF)
Use human feedback to increase your model’s usefulness
TTP
Use Cases: RLHF is particularly useful in industries where customer
satisfaction is critical, such as healthcare, finance, and e-
commerce. With RLHF, can to train their models to better
understand and respond to user needs, ultimately leading to higher
customer satisfaction and engagement.

30. Proprietary + Confidential
ENTERPRISE READINESS

31. Proprietary + Confidential
Enterprise Architecture
Google Cloud
Central Hosting
Your Google Cloud Tenant
Large Model
(Frozen)
Adapter Layers
Your
Data
Your
Inference
Generative AI
App Builder
Enterprise
search
Conversation
AI
Chatbot, API, etc.
Internet/Intranet
Your Users
Your OnPrem or
Alternative Cloud
Vertex AI
Data in flight is
encrypted
Only processes input to
generate output
Does NOT store
customer data or
parameters
Does NOT use
customer data to
improve model
Adapter Layers
consist of params
tuned on user data,
and is served from
user Tenant.

32. Proprietary + Confidential
Enterprise Architecture & Data Movement
Google Cloud
Central Hosting
Your Google Cloud Tenant
Large Model
(Frozen)
Model
Inference
via Prompts
API or UI
Chatbot, API, etc.
Internet/Intranet
Your Users
Your OnPrem or
Alternative Cloud
normal request
response
Data in flight is
encrypted
Only processes input to
generate output
Does NOT store
customer data or
parameters
Does NOT use
customer data to
improve model

33. Proprietary + Confidential
Enterprise Architecture & Data Movement
Google Cloud
Central Hosting
Your Google Cloud Tenant
Large Model
(Frozen)
Your Data
Model
Inference
via Prompts
API or UI
Chatbot, API, etc.
Internet/Intranet
Your Users
Your OnPrem or
Alternative Cloud
normal request
response
request to
tuned model
Adapter Layers
Data in flight is
encrypted
Only processes input to
generate output
Does NOT store
customer data or
parameters
Does NOT use
customer data to
improve model

34. Proprietary + Confidential
Google Cloud’s approach to Responsible AI
Education, research & tools
Online training courses, guidebooks, research papers,
product documentation, RAI best practices, Tensorflow
Responsible AI toolkit
Product & use case reviews
Customer AI Use case & Product Development Reviews,
Fairness Testing
Responsible AI offerings
ML Metadata, Model Registry, Model Monitoring, safety
scores & filters
Generative AI comes with its own set of
unique challenges.
At Google, we are integrating AI into our
products boldly and with a deep sense of
responsibility and highest standards of
information integrity with our AI principles.

35. Proprietary + Confidential
WHY GOOGLE AND NEXT
STEPS

36. Proprietary + Confidential
Why Google?
Google Cloud ensures that your
data is governed to prevent IP
leakage while deploying
Generative AI.
Govern your
data
Match cost to
value
Bigger is not always better
when it comes to inference
cost. Vertex AI gives you the
ability to use the right model for
the right job.
Grounded in
factuality
It's important to not just provide
an answer but to prove where
the answer came from.
Integrate databases and search
results to ground your results.
Cloud AI gives you a wide range
of easy to use tools to get
started in days, instead of
needing to be a deep learning
expert for every use case.
Easy to get
started
Manageable at
scale
Google Cloud provides a
platform that integrates into
your existing user security, data
management, and entitlements
regime to manage your myriad
data and models.

37. Proprietary + Confidential
Thank You