Understanding LLM/GenAI
Google Portfolio of AI Services
Felix Goh
Strategic Lead, Singapore
Education, Research and EdTech
Global Public Sector, Google Cloud
M: +65 90117062 | E: fgoh@google.com
Introductions
Born and breed in Singapore, gone through the
Singapore education system & military system.
Started my career as an IT Trainer teaching Pri - Sec
school students.
Focused on the education sector for over 17 years
holding technical, consultant, program and sales
roles.
The AI Revolution & How it’s impacted Industries
Exploring Google Portfolio of Services
What’s Next and how do I get started?
Contents
Organize the world’s information
and make it universally
accessible and useful
1969
Information
Technology
1870
Electricity
1784
Steam Power
Today
We’re in an
AI driven
revolution
Source: AI: Recent Trends and Applications, Emerging Communication and Computing
Confidential + Proprietary
First, some vocab
Generative Model: An ML model that produces content, including language,
code, imagery, music, video, etc.
Large Language Model: machine learning models that are really good at
understanding and generating human language. Large refers to both size and
complexity of the neural network itself, as well as the size of the dataset it was
trained on. Can also be used for non-generative language tasks (eg classification)
Transformer: The neural network architecture underlying most of today’s
generative models (and, more widely, most SOTA ML models). Published by Google
in 2017.
What is
Generative AI?
AI
Artificial Intelligence
Ability for machines to
mimic human intelligence
ML
Machine Learning
Making predictions using data
NLP
Natural Language Processing
Machine learning with text data
as input
DL
Deep Learning
Based on deep neural network
LLM
Large Language Models
NLP neural networks based on
1b+ model parameters
GLM
Universal/Foundation Models
General purpose language
models, text generation models
capable of solving many use
cases
The Path to Generative Language Models
Traditional Programming
Is this a cat?
This is a cat.
This is not a cat.
Yes.
Wave of Neural Networks (~2012)
Go read this huge
pile of books.
So, you’ve learned
about cats and a ton
of other concepts.
What’s a cat?
A cat is…
Generative Language Models
Google pioneered AI advances for a decade…
Responsible AI at the foundation
Making AI more helpful for
everyone
Proprietary + Confidential
A paradigm shift across industries powered by
Generative AI
Internal - The Impact of Generative AI in the Enterprise
Technology Media & Telecom Consumer & Retail
Life Sciences &
Healthcare
Banking & Fin.
Services
Industrial &
Manufacturing
Government &
Public Sector
Personalized
AR/VR
Experience
Generation
Interactive
Streaming & User
Engagement
Conversational
eCommerce &
Retail
AR/VR Content
Generation for
Digital Therapy
Fraud Simulation
& Pattern
Detection
Generative AR/VR
Product design
Academic 24/7
Office Hours
Virtual Assistant
Personalized &
Automated
UI/UX Design
Trailer Generation
& Feedback
Curation
Customized
Product Design &
Recommendation
Predictive &
Virtual Patient
Triage
Tax and
Compliance Audit
& Scenario
Testing
Generative
Simulation &
Safety Testing
Infrastructure
Mapping &
Planning
Synthetic
Outage / Threat
Simulation for
Testing
Script/Score
Design & Subtitle
Generation
Product Details &
Photography
Generation
Protein
Sequence
Modeling for
Drug Discovery
Personalized
Virtual Financial
Advisor
Text-to-Simulatio
n Product Design
& Development
Predictive
Policing &
Emergency
Response
Autonomous
Code
Generation &
Completions
Personalized News
& Content
Generation
Digital Shopping
Assistant & Exp.
Management
Genomic
Analysis for
Personalized
Therapy Plans
End-to-end
Automated
Claims
Processing
Automated
Technical
Equipment
Training
Personalized
Academic
Planning &
Testing
Automated
Debugging &
Issue Resolution
Personalized
Wired/Wireless
Phone Plans
Personal Travel
& Logistics
Assistant
Diagnostic
Decision
Support &
Report
Generation
Financial
Reporting
Analysis & Insight
Generation
Generative
Automation for
Smart Factories
NLP-based
Administrative
Processing
Generative Product /
Offering Design
Self-serve HR &
IT functions
End-to-end Automated
Customer Service
Accessibility Support
(text-to-speech &
speech-to-text)
Social Media Marketing
Campaign Generation
Enterprise Search &
Knowledge Management
Text Summarization &
Image Generation
Marketing / Sales
Content Generation
Customer Feedback
Sentiment Classification
Market Research
Acceleration
Vertical
Use
Cases
Horizontal
Use
Cases
Emerging
Mature
Early value capture through horizontal
use cases across industries such as
customer support, content generation
Vertical use cases will require nuanced
domain expertise and customized
models
Google Workspace brings the
best of Google to Education
AppSheet
Productivity &
Work Transformation
Even with Google Workspace…
Spelling & Grammar Suggestions
Smart Reply
Noise Cancellation
Portrait Restore
Smart Compose
Malware Detection and Prevention
2017 2018 2019 2020 2021 2022 2023
2016
Explore
2015
Suggested Actions
Chart Suggestions
Answers
Grammar Suggestions
Formula Acceleration Formula Suggestions
Smart Compose
Smart Compose
File Suggestions
Write & Re-Write
AI-Generated Summaries
Sharing Suggestions
Generative AI in
Google Workspace
Easily integrate an intuitive,
natural language experience
that delights your customers
and drivers conversion into
your existing consumer
search apps and platform.
Google Workspace Duet AI
Demo
Google Cloud brings the
best of Google to Education
AppSheet
Compute
Engine
Google
Kubernetes
Engine
App
Engine
Cloud
Storage
Cloud
VPN
Google
Cloud
Armor
Application
Migration
Security
Command
Center
IAM
Virtual
Private
Cloud
Cloud
Network
Contact
Center AI
BigQuery AI Platform Cloud
Spanner
Cloud
SQL
Apigee API
Platform
Cloud
Data
Fusion
Apigee
Sense
Productivity &
Work Transformation
Public Cloud Hybrid Cloud Multi Cloud Edge Cloud
Infrastructure-as-a-Service
Insights Platform/
Smart Analytics
-as-a-Service
Data
Management
-as-a-Service
API Management
-as-a-Service
Application
Platform
-as-a-Service
Generative AI: for businesses & governments
Generative AI support in Vertex AI
Generative AI APIs, end to end support from serving to tuning of
foundation models
● Generative AI APIs across multiple modalities
● Model Garden and Generative AI Studio
● Prompt design and prompt tuning
● Fine tuning of foundation models
● Foundation model support for training, prediction and ML Ops
Generative AI App Builder
Fast application development leveraging the power of search,
immersive conversational experiences, and foundation models
with enterprise controls
Search
● Google-quality out-of-box
search
● Tuneable
● Multimodal
● Conversational
Conversation
● Single Turn
● Multi Turn
● Information Seeking
● Transactional
● Flow Control
Expanding our portfolio
To support the needs of Generative AI centric enterprise development
Business users
Developers
AI Practitioners
Vertex AI
Powered by Foundation Models
CCAI Document AI Discovery AI Healthcare AI
Conversation AI
Enterprise Search
Foundation
Models
Generative AI
App Builder
End-to-End ML Platform
Generative AI Studio | Generative AI APIs | Model Garden
Google Cloud Infrastructure
Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
Conversation AI Builder
Proprietary + Confidential
Enterprise Search
Developers
No ML skill required
AI Practitioners
Advanced ML skill
OOTB search
Google-quality out-of-the-box search
experience for implementers
Fast and easy setup for
Application Developers
Tuneable, multimodal, &
conversational search
“Tune the OOTB” search
Customization for
Search Developers
Build your own search
“Build your own” search with advanced
ML/AI
Model training/ tuning for
AI/ML Engineers
Enterprise Search Builder
Education, research & tools
Online training courses, guidebooks, research papers,
product documentation, RAI best practices, Tensorflow
Responsible AI toolkit
Product & use case reviews
Customer AI Use case & Product Development Reviews,
Fairness Testing
Responsible AI offerings
ML Metadata, Model Registry, Explainable AI, Model
Monitoring
AI comes with its own set
of unique challenges.
At Google, we are integrating AI into our
products boldly and with a deep sense of
responsibility and highest standards of
information integrity with our AI principles.
Responsible AI at the foundation
surveillance violating internationally
accepted norms
1 be socially beneficial
avoid creating or reinforcing unfair bias
2
be built and tested for safety
3
be accountable to people
4
incorporate privacy design principles
5
uphold high standards of scientific
excellence
6
7 be made available for uses that accord
with these principles
AI should:
likely to cause overall harm
principal purpose to direct injury
purpose contravenes international law
and human rights
Google
AI Principles
1
2
3
4
Applications we will
not pursue:
So what’s next?
Introduction to Generative AI Learning Path
This learning path provides an overview of generative AI concepts, from the fundamentals of large language
models to responsible AI principles.
Introduction to Large Language Models
An introductory level micro-learning course that explores what large language models (LLM) are, the use cases where they can be utilized,
and how you can use prompt tuning to enhance LLM performance. It also covers Google tools to help you develop your own Gen AI apps.
Google Certified Coach (GCC)
The Certified Coach program empowers
instructional coaches to work 1:1 with
educators and drive impactful technology
use in their schools.
Google Certified Educator
Level 1 (GCE Level 1)
The Google Certified Educator Level 1
offers certification on the fundamentals of
Google Workspace for Education.
Google Certified Innovator (GCI)
The Certified Innovator program are for educators
who innovate with technology to solve meaningful
challenges in educator.
Google Certified Trainer (GCT)
The Certified Trainer program empowers
instructional leaders to train, develop, and
support educators in learning with technology
Google Certified Educator
Level 2 (GCE Level 2)
The Google Certified Educator Level 2
offers certification on the advance uses of
Google Workspace for Education.
Google Certified Educator
In Google for Education, we offer certification programs to help educators equip
themselves with the right tools. These certifications are globally recognised and provides
opportunities for educators to be leaders in their schools.
● Explore what you can do with Google
Cloud Platform to engage students
and enhance teaching.
● It is the intent of the program that the
credits are used by students to learn
how to use the cloud for career
development purposes.
● Faculty can apply to receive $100 in
GCP credits and $50 per student.
Credits can be used in courses,
student clubs, and other
faculty-sponsored events.
Google Cloud
Credits for Learning
● Get hands-on experience using
Google Cloud Platform with training
for everyone from beginners through
advanced users.
● Faculty can apply for 5,000 Qwiklabs
credits, while students and IT enablers
can apply for 200 credits. Everyone
can request free access to 13 online
training courses in Coursera.
Google Cloud
Training Credits
● Transform research data into valuable
insights and conduct large-scale
analyses with the power of Google
Cloud Platform.
● Research faculty can apply for up to
$5,000 in Google Cloud Platform
credits for academic research.
Google Cloud Research
Credits
Google Cloud Programs for Education
Fuel new research, encourage teachers to innovate, and offer Google Cloud Platform training and
certification with credits and discounts from Google
● Google Cloud Generative AI Learning Path
● Google Skillshop
● Skills Ignition SG
● Google Digital Garage
● Google Bard
● Google AI Test Kitchen
● Google AI
● Google Interland
Additional
Resources
Thank you for attending NUS-ISS Learning Festival!
We hope you have gain great insights and knowledge from the sessions today and we want to
hear from you!
1. Post your photo or video on your Facebook/Instagram/TikTok/Linkedin account. Remember to
make your post public!
2. Use the hashtag #NUSISSLearningFestival and tag our official account (@iss.nus/@nus_iss)
to make sure we see your masterpiece.
3. In the caption, share your insights or takeaways from the festival. What have you learned?
What inspired you?
The best entries will get a complimentary course of your choice from our Blended Learning
Programmes!
Let's make learning a blast! 🚀💡😁
Share Your Learnings!
We’d Love to Hear From You
Speakers’ decks will be shared with attendees who completed the post event survey.
Thank You
Felix Goh
Strategic Lead, Singapore
Education, Research and EdTech
Global Public Sector, Google Cloud
M: +65 90117062 | E: fgoh@google.com

Understanding GenAI/LLM and What is Google Offering - Felix Goh

  • 1.
    Understanding LLM/GenAI Google Portfolioof AI Services Felix Goh Strategic Lead, Singapore Education, Research and EdTech Global Public Sector, Google Cloud M: +65 90117062 | E: fgoh@google.com
  • 2.
    Introductions Born and breedin Singapore, gone through the Singapore education system & military system. Started my career as an IT Trainer teaching Pri - Sec school students. Focused on the education sector for over 17 years holding technical, consultant, program and sales roles.
  • 3.
    The AI Revolution& How it’s impacted Industries Exploring Google Portfolio of Services What’s Next and how do I get started? Contents
  • 4.
    Organize the world’sinformation and make it universally accessible and useful
  • 5.
    1969 Information Technology 1870 Electricity 1784 Steam Power Today We’re inan AI driven revolution Source: AI: Recent Trends and Applications, Emerging Communication and Computing
  • 6.
    Confidential + Proprietary First,some vocab Generative Model: An ML model that produces content, including language, code, imagery, music, video, etc. Large Language Model: machine learning models that are really good at understanding and generating human language. Large refers to both size and complexity of the neural network itself, as well as the size of the dataset it was trained on. Can also be used for non-generative language tasks (eg classification) Transformer: The neural network architecture underlying most of today’s generative models (and, more widely, most SOTA ML models). Published by Google in 2017.
  • 7.
    What is Generative AI? AI ArtificialIntelligence Ability for machines to mimic human intelligence ML Machine Learning Making predictions using data NLP Natural Language Processing Machine learning with text data as input DL Deep Learning Based on deep neural network LLM Large Language Models NLP neural networks based on 1b+ model parameters GLM Universal/Foundation Models General purpose language models, text generation models capable of solving many use cases
  • 8.
    The Path toGenerative Language Models Traditional Programming Is this a cat? This is a cat. This is not a cat. Yes. Wave of Neural Networks (~2012) Go read this huge pile of books. So, you’ve learned about cats and a ton of other concepts. What’s a cat? A cat is… Generative Language Models
  • 9.
    Google pioneered AIadvances for a decade… Responsible AI at the foundation
  • 11.
    Making AI morehelpful for everyone
  • 12.
    Proprietary + Confidential Aparadigm shift across industries powered by Generative AI Internal - The Impact of Generative AI in the Enterprise Technology Media & Telecom Consumer & Retail Life Sciences & Healthcare Banking & Fin. Services Industrial & Manufacturing Government & Public Sector Personalized AR/VR Experience Generation Interactive Streaming & User Engagement Conversational eCommerce & Retail AR/VR Content Generation for Digital Therapy Fraud Simulation & Pattern Detection Generative AR/VR Product design Academic 24/7 Office Hours Virtual Assistant Personalized & Automated UI/UX Design Trailer Generation & Feedback Curation Customized Product Design & Recommendation Predictive & Virtual Patient Triage Tax and Compliance Audit & Scenario Testing Generative Simulation & Safety Testing Infrastructure Mapping & Planning Synthetic Outage / Threat Simulation for Testing Script/Score Design & Subtitle Generation Product Details & Photography Generation Protein Sequence Modeling for Drug Discovery Personalized Virtual Financial Advisor Text-to-Simulatio n Product Design & Development Predictive Policing & Emergency Response Autonomous Code Generation & Completions Personalized News & Content Generation Digital Shopping Assistant & Exp. Management Genomic Analysis for Personalized Therapy Plans End-to-end Automated Claims Processing Automated Technical Equipment Training Personalized Academic Planning & Testing Automated Debugging & Issue Resolution Personalized Wired/Wireless Phone Plans Personal Travel & Logistics Assistant Diagnostic Decision Support & Report Generation Financial Reporting Analysis & Insight Generation Generative Automation for Smart Factories NLP-based Administrative Processing Generative Product / Offering Design Self-serve HR & IT functions End-to-end Automated Customer Service Accessibility Support (text-to-speech & speech-to-text) Social Media Marketing Campaign Generation Enterprise Search & Knowledge Management Text Summarization & Image Generation Marketing / Sales Content Generation Customer Feedback Sentiment Classification Market Research Acceleration Vertical Use Cases Horizontal Use Cases Emerging Mature Early value capture through horizontal use cases across industries such as customer support, content generation Vertical use cases will require nuanced domain expertise and customized models
  • 13.
    Google Workspace bringsthe best of Google to Education AppSheet Productivity & Work Transformation
  • 14.
    Even with GoogleWorkspace… Spelling & Grammar Suggestions Smart Reply Noise Cancellation Portrait Restore Smart Compose Malware Detection and Prevention 2017 2018 2019 2020 2021 2022 2023 2016 Explore 2015 Suggested Actions Chart Suggestions Answers Grammar Suggestions Formula Acceleration Formula Suggestions Smart Compose Smart Compose File Suggestions Write & Re-Write AI-Generated Summaries Sharing Suggestions
  • 15.
    Generative AI in GoogleWorkspace Easily integrate an intuitive, natural language experience that delights your customers and drivers conversion into your existing consumer search apps and platform.
  • 16.
  • 17.
    Google Cloud bringsthe best of Google to Education AppSheet Compute Engine Google Kubernetes Engine App Engine Cloud Storage Cloud VPN Google Cloud Armor Application Migration Security Command Center IAM Virtual Private Cloud Cloud Network Contact Center AI BigQuery AI Platform Cloud Spanner Cloud SQL Apigee API Platform Cloud Data Fusion Apigee Sense Productivity & Work Transformation Public Cloud Hybrid Cloud Multi Cloud Edge Cloud Infrastructure-as-a-Service Insights Platform/ Smart Analytics -as-a-Service Data Management -as-a-Service API Management -as-a-Service Application Platform -as-a-Service
  • 18.
    Generative AI: forbusinesses & governments Generative AI support in Vertex AI Generative AI APIs, end to end support from serving to tuning of foundation models ● Generative AI APIs across multiple modalities ● Model Garden and Generative AI Studio ● Prompt design and prompt tuning ● Fine tuning of foundation models ● Foundation model support for training, prediction and ML Ops Generative AI App Builder Fast application development leveraging the power of search, immersive conversational experiences, and foundation models with enterprise controls Search ● Google-quality out-of-box search ● Tuneable ● Multimodal ● Conversational Conversation ● Single Turn ● Multi Turn ● Information Seeking ● Transactional ● Flow Control
  • 19.
    Expanding our portfolio Tosupport the needs of Generative AI centric enterprise development Business users Developers AI Practitioners Vertex AI Powered by Foundation Models CCAI Document AI Discovery AI Healthcare AI Conversation AI Enterprise Search Foundation Models Generative AI App Builder End-to-End ML Platform Generative AI Studio | Generative AI APIs | Model Garden Google Cloud Infrastructure Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
  • 20.
  • 21.
    Proprietary + Confidential EnterpriseSearch Developers No ML skill required AI Practitioners Advanced ML skill OOTB search Google-quality out-of-the-box search experience for implementers Fast and easy setup for Application Developers Tuneable, multimodal, & conversational search “Tune the OOTB” search Customization for Search Developers Build your own search “Build your own” search with advanced ML/AI Model training/ tuning for AI/ML Engineers
  • 22.
  • 23.
    Education, research &tools Online training courses, guidebooks, research papers, product documentation, RAI best practices, Tensorflow Responsible AI toolkit Product & use case reviews Customer AI Use case & Product Development Reviews, Fairness Testing Responsible AI offerings ML Metadata, Model Registry, Explainable AI, Model Monitoring AI comes with its own set of unique challenges. At Google, we are integrating AI into our products boldly and with a deep sense of responsibility and highest standards of information integrity with our AI principles. Responsible AI at the foundation
  • 24.
    surveillance violating internationally acceptednorms 1 be socially beneficial avoid creating or reinforcing unfair bias 2 be built and tested for safety 3 be accountable to people 4 incorporate privacy design principles 5 uphold high standards of scientific excellence 6 7 be made available for uses that accord with these principles AI should: likely to cause overall harm principal purpose to direct injury purpose contravenes international law and human rights Google AI Principles 1 2 3 4 Applications we will not pursue:
  • 25.
  • 26.
    Introduction to GenerativeAI Learning Path This learning path provides an overview of generative AI concepts, from the fundamentals of large language models to responsible AI principles.
  • 27.
    Introduction to LargeLanguage Models An introductory level micro-learning course that explores what large language models (LLM) are, the use cases where they can be utilized, and how you can use prompt tuning to enhance LLM performance. It also covers Google tools to help you develop your own Gen AI apps.
  • 28.
    Google Certified Coach(GCC) The Certified Coach program empowers instructional coaches to work 1:1 with educators and drive impactful technology use in their schools. Google Certified Educator Level 1 (GCE Level 1) The Google Certified Educator Level 1 offers certification on the fundamentals of Google Workspace for Education. Google Certified Innovator (GCI) The Certified Innovator program are for educators who innovate with technology to solve meaningful challenges in educator. Google Certified Trainer (GCT) The Certified Trainer program empowers instructional leaders to train, develop, and support educators in learning with technology Google Certified Educator Level 2 (GCE Level 2) The Google Certified Educator Level 2 offers certification on the advance uses of Google Workspace for Education. Google Certified Educator In Google for Education, we offer certification programs to help educators equip themselves with the right tools. These certifications are globally recognised and provides opportunities for educators to be leaders in their schools.
  • 29.
    ● Explore whatyou can do with Google Cloud Platform to engage students and enhance teaching. ● It is the intent of the program that the credits are used by students to learn how to use the cloud for career development purposes. ● Faculty can apply to receive $100 in GCP credits and $50 per student. Credits can be used in courses, student clubs, and other faculty-sponsored events. Google Cloud Credits for Learning ● Get hands-on experience using Google Cloud Platform with training for everyone from beginners through advanced users. ● Faculty can apply for 5,000 Qwiklabs credits, while students and IT enablers can apply for 200 credits. Everyone can request free access to 13 online training courses in Coursera. Google Cloud Training Credits ● Transform research data into valuable insights and conduct large-scale analyses with the power of Google Cloud Platform. ● Research faculty can apply for up to $5,000 in Google Cloud Platform credits for academic research. Google Cloud Research Credits Google Cloud Programs for Education Fuel new research, encourage teachers to innovate, and offer Google Cloud Platform training and certification with credits and discounts from Google
  • 30.
    ● Google CloudGenerative AI Learning Path ● Google Skillshop ● Skills Ignition SG ● Google Digital Garage ● Google Bard ● Google AI Test Kitchen ● Google AI ● Google Interland Additional Resources
  • 31.
    Thank you forattending NUS-ISS Learning Festival! We hope you have gain great insights and knowledge from the sessions today and we want to hear from you! 1. Post your photo or video on your Facebook/Instagram/TikTok/Linkedin account. Remember to make your post public! 2. Use the hashtag #NUSISSLearningFestival and tag our official account (@iss.nus/@nus_iss) to make sure we see your masterpiece. 3. In the caption, share your insights or takeaways from the festival. What have you learned? What inspired you? The best entries will get a complimentary course of your choice from our Blended Learning Programmes! Let's make learning a blast! 🚀💡😁 Share Your Learnings!
  • 32.
    We’d Love toHear From You Speakers’ decks will be shared with attendees who completed the post event survey.
  • 33.
    Thank You Felix Goh StrategicLead, Singapore Education, Research and EdTech Global Public Sector, Google Cloud M: +65 90117062 | E: fgoh@google.com