With the recent buzz on Generative AI & Large Language Models, the question is to what extent can these technologies be applied at work or when you're studying and how easy is it to manage/develop your own models? Hear from our guest speaker from Google as he shares some insights into how industries are evolving with these trends and what are some of Google's offerings from Duet AI in Google Workspace to the GenAI App Builder on Google Cloud.
Understanding LLM/GenAI and Google's Portfolio of AI Services
1. Understanding LLM/GenAI
Google Portfolio of AI Services
Felix Goh
Strategic Lead, Singapore
Education, Research and EdTech
Global Public Sector, Google Cloud
M: +65 90117062 | E: fgoh@google.com
2. Introductions
Born and breed in Singapore, gone through the
Singapore education system & military system.
Started my career as an IT Trainer teaching Pri - Sec
school students.
Focused on the education sector for over 17 years
holding technical, consultant, program and sales
roles.
3. The AI Revolution & How it’s impacted Industries
Exploring Google Portfolio of Services
What’s Next and how do I get started?
Contents
6. Confidential + Proprietary
First, some vocab
Generative Model: An ML model that produces content, including language,
code, imagery, music, video, etc.
Large Language Model: machine learning models that are really good at
understanding and generating human language. Large refers to both size and
complexity of the neural network itself, as well as the size of the dataset it was
trained on. Can also be used for non-generative language tasks (eg classification)
Transformer: The neural network architecture underlying most of today’s
generative models (and, more widely, most SOTA ML models). Published by Google
in 2017.
7. What is
Generative AI?
AI
Artificial Intelligence
Ability for machines to
mimic human intelligence
ML
Machine Learning
Making predictions using data
NLP
Natural Language Processing
Machine learning with text data
as input
DL
Deep Learning
Based on deep neural network
LLM
Large Language Models
NLP neural networks based on
1b+ model parameters
GLM
Universal/Foundation Models
General purpose language
models, text generation models
capable of solving many use
cases
8. The Path to Generative Language Models
Traditional Programming
Is this a cat?
This is a cat.
This is not a cat.
Yes.
Wave of Neural Networks (~2012)
Go read this huge
pile of books.
So, you’ve learned
about cats and a ton
of other concepts.
What’s a cat?
A cat is…
Generative Language Models
12. Proprietary + Confidential
A paradigm shift across industries powered by
Generative AI
Internal - The Impact of Generative AI in the Enterprise
Technology Media & Telecom Consumer & Retail
Life Sciences &
Healthcare
Banking & Fin.
Services
Industrial &
Manufacturing
Government &
Public Sector
Personalized
AR/VR
Experience
Generation
Interactive
Streaming & User
Engagement
Conversational
eCommerce &
Retail
AR/VR Content
Generation for
Digital Therapy
Fraud Simulation
& Pattern
Detection
Generative AR/VR
Product design
Academic 24/7
Office Hours
Virtual Assistant
Personalized &
Automated
UI/UX Design
Trailer Generation
& Feedback
Curation
Customized
Product Design &
Recommendation
Predictive &
Virtual Patient
Triage
Tax and
Compliance Audit
& Scenario
Testing
Generative
Simulation &
Safety Testing
Infrastructure
Mapping &
Planning
Synthetic
Outage / Threat
Simulation for
Testing
Script/Score
Design & Subtitle
Generation
Product Details &
Photography
Generation
Protein
Sequence
Modeling for
Drug Discovery
Personalized
Virtual Financial
Advisor
Text-to-Simulatio
n Product Design
& Development
Predictive
Policing &
Emergency
Response
Autonomous
Code
Generation &
Completions
Personalized News
& Content
Generation
Digital Shopping
Assistant & Exp.
Management
Genomic
Analysis for
Personalized
Therapy Plans
End-to-end
Automated
Claims
Processing
Automated
Technical
Equipment
Training
Personalized
Academic
Planning &
Testing
Automated
Debugging &
Issue Resolution
Personalized
Wired/Wireless
Phone Plans
Personal Travel
& Logistics
Assistant
Diagnostic
Decision
Support &
Report
Generation
Financial
Reporting
Analysis & Insight
Generation
Generative
Automation for
Smart Factories
NLP-based
Administrative
Processing
Generative Product /
Offering Design
Self-serve HR &
IT functions
End-to-end Automated
Customer Service
Accessibility Support
(text-to-speech &
speech-to-text)
Social Media Marketing
Campaign Generation
Enterprise Search &
Knowledge Management
Text Summarization &
Image Generation
Marketing / Sales
Content Generation
Customer Feedback
Sentiment Classification
Market Research
Acceleration
Vertical
Use
Cases
Horizontal
Use
Cases
Emerging
Mature
Early value capture through horizontal
use cases across industries such as
customer support, content generation
Vertical use cases will require nuanced
domain expertise and customized
models
13. Google Workspace brings the
best of Google to Education
AppSheet
Productivity &
Work Transformation
14. Even with Google Workspace…
Spelling & Grammar Suggestions
Smart Reply
Noise Cancellation
Portrait Restore
Smart Compose
Malware Detection and Prevention
2017 2018 2019 2020 2021 2022 2023
2016
Explore
2015
Suggested Actions
Chart Suggestions
Answers
Grammar Suggestions
Formula Acceleration Formula Suggestions
Smart Compose
Smart Compose
File Suggestions
Write & Re-Write
AI-Generated Summaries
Sharing Suggestions
15. Generative AI in
Google Workspace
Easily integrate an intuitive,
natural language experience
that delights your customers
and drivers conversion into
your existing consumer
search apps and platform.
17. Google Cloud brings the
best of Google to Education
AppSheet
Compute
Engine
Google
Kubernetes
Engine
App
Engine
Cloud
Storage
Cloud
VPN
Google
Cloud
Armor
Application
Migration
Security
Command
Center
IAM
Virtual
Private
Cloud
Cloud
Network
Contact
Center AI
BigQuery AI Platform Cloud
Spanner
Cloud
SQL
Apigee API
Platform
Cloud
Data
Fusion
Apigee
Sense
Productivity &
Work Transformation
Public Cloud Hybrid Cloud Multi Cloud Edge Cloud
Infrastructure-as-a-Service
Insights Platform/
Smart Analytics
-as-a-Service
Data
Management
-as-a-Service
API Management
-as-a-Service
Application
Platform
-as-a-Service
18. Generative AI: for businesses & governments
Generative AI support in Vertex AI
Generative AI APIs, end to end support from serving to tuning of
foundation models
● Generative AI APIs across multiple modalities
● Model Garden and Generative AI Studio
● Prompt design and prompt tuning
● Fine tuning of foundation models
● Foundation model support for training, prediction and ML Ops
Generative AI App Builder
Fast application development leveraging the power of search,
immersive conversational experiences, and foundation models
with enterprise controls
Search
● Google-quality out-of-box
search
● Tuneable
● Multimodal
● Conversational
Conversation
● Single Turn
● Multi Turn
● Information Seeking
● Transactional
● Flow Control
19. Expanding our portfolio
To support the needs of Generative AI centric enterprise development
Business users
Developers
AI Practitioners
Vertex AI
Powered by Foundation Models
CCAI Document AI Discovery AI Healthcare AI
Conversation AI
Enterprise Search
Foundation
Models
Generative AI
App Builder
End-to-End ML Platform
Generative AI Studio | Generative AI APIs | Model Garden
Google Cloud Infrastructure
Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
21. Proprietary + Confidential
Enterprise Search
Developers
No ML skill required
AI Practitioners
Advanced ML skill
OOTB search
Google-quality out-of-the-box search
experience for implementers
Fast and easy setup for
Application Developers
Tuneable, multimodal, &
conversational search
“Tune the OOTB” search
Customization for
Search Developers
Build your own search
“Build your own” search with advanced
ML/AI
Model training/ tuning for
AI/ML Engineers
23. Education, research & tools
Online training courses, guidebooks, research papers,
product documentation, RAI best practices, Tensorflow
Responsible AI toolkit
Product & use case reviews
Customer AI Use case & Product Development Reviews,
Fairness Testing
Responsible AI offerings
ML Metadata, Model Registry, Explainable AI, Model
Monitoring
AI comes with its own set
of unique challenges.
At Google, we are integrating AI into our
products boldly and with a deep sense of
responsibility and highest standards of
information integrity with our AI principles.
Responsible AI at the foundation
24. surveillance violating internationally
accepted norms
1 be socially beneficial
avoid creating or reinforcing unfair bias
2
be built and tested for safety
3
be accountable to people
4
incorporate privacy design principles
5
uphold high standards of scientific
excellence
6
7 be made available for uses that accord
with these principles
AI should:
likely to cause overall harm
principal purpose to direct injury
purpose contravenes international law
and human rights
Google
AI Principles
1
2
3
4
Applications we will
not pursue:
26. Introduction to Generative AI Learning Path
This learning path provides an overview of generative AI concepts, from the fundamentals of large language
models to responsible AI principles.
27. Introduction to Large Language Models
An introductory level micro-learning course that explores what large language models (LLM) are, the use cases where they can be utilized,
and how you can use prompt tuning to enhance LLM performance. It also covers Google tools to help you develop your own Gen AI apps.
28. Google Certified Coach (GCC)
The Certified Coach program empowers
instructional coaches to work 1:1 with
educators and drive impactful technology
use in their schools.
Google Certified Educator
Level 1 (GCE Level 1)
The Google Certified Educator Level 1
offers certification on the fundamentals of
Google Workspace for Education.
Google Certified Innovator (GCI)
The Certified Innovator program are for educators
who innovate with technology to solve meaningful
challenges in educator.
Google Certified Trainer (GCT)
The Certified Trainer program empowers
instructional leaders to train, develop, and
support educators in learning with technology
Google Certified Educator
Level 2 (GCE Level 2)
The Google Certified Educator Level 2
offers certification on the advance uses of
Google Workspace for Education.
Google Certified Educator
In Google for Education, we offer certification programs to help educators equip
themselves with the right tools. These certifications are globally recognised and provides
opportunities for educators to be leaders in their schools.
29. ● Explore what you can do with Google
Cloud Platform to engage students
and enhance teaching.
● It is the intent of the program that the
credits are used by students to learn
how to use the cloud for career
development purposes.
● Faculty can apply to receive $100 in
GCP credits and $50 per student.
Credits can be used in courses,
student clubs, and other
faculty-sponsored events.
Google Cloud
Credits for Learning
● Get hands-on experience using
Google Cloud Platform with training
for everyone from beginners through
advanced users.
● Faculty can apply for 5,000 Qwiklabs
credits, while students and IT enablers
can apply for 200 credits. Everyone
can request free access to 13 online
training courses in Coursera.
Google Cloud
Training Credits
● Transform research data into valuable
insights and conduct large-scale
analyses with the power of Google
Cloud Platform.
● Research faculty can apply for up to
$5,000 in Google Cloud Platform
credits for academic research.
Google Cloud Research
Credits
Google Cloud Programs for Education
Fuel new research, encourage teachers to innovate, and offer Google Cloud Platform training and
certification with credits and discounts from Google
30. ● Google Cloud Generative AI Learning Path
● Google Skillshop
● Skills Ignition SG
● Google Digital Garage
● Google Bard
● Google AI Test Kitchen
● Google AI
● Google Interland
Additional
Resources
31. Thank you for attending NUS-ISS Learning Festival!
We hope you have gain great insights and knowledge from the sessions today and we want to
hear from you!
1. Post your photo or video on your Facebook/Instagram/TikTok/Linkedin account. Remember to
make your post public!
2. Use the hashtag #NUSISSLearningFestival and tag our official account (@iss.nus/@nus_iss)
to make sure we see your masterpiece.
3. In the caption, share your insights or takeaways from the festival. What have you learned?
What inspired you?
The best entries will get a complimentary course of your choice from our Blended Learning
Programmes!
Let's make learning a blast! 🚀💡😁
Share Your Learnings!
32. We’d Love to Hear From You
Speakers’ decks will be shared with attendees who completed the post event survey.
33. Thank You
Felix Goh
Strategic Lead, Singapore
Education, Research and EdTech
Global Public Sector, Google Cloud
M: +65 90117062 | E: fgoh@google.com