See what's new in #Serverless and #Data at GCP. Our guest, Guillaume Blaquiere - Stack Overflow contributor & #GCP #Developer Expert from France, covered the best #GoogleCloudNext announcements, practically demoed how to benefit from #BigQuery Remote Functions and answered many questions. The meetup recording with TOC for easy navigation is at https://youtu.be/AuZZTwHIcdY P.S. For more interactive lectures like this, go to http://youtube.serverlesstoronto.org/ or sign up for our upcoming live events at https://www.meetup.com/Serverless-Toronto/events/

1. ServerlessToronto.org meetup @ 5:40pm
1
Introduce yourself:
- Where from? Why
are you here?
AGENDA
1. No intro, watch the last
meetup instead:
http://youtube.serverle
sstoronto.org/
2. Why this topic?
3. Why Guillaume?
4. Feature Presentation,
Q&A & Manning
Publishing raffle
5. What’s next at
Serverless Toronto in
2023

2. Oct/
11–13
Serverless services
and Cloud Next
announcements

3. Guillaume Blaquière
Google Developer Expert - Cloud
Group Data Architect
Carrefour

4. Operational
Model
No Infra
Management
Fully Managed
Security
Pay only
for usage
Economic
Model
Programming
Model
Service
based
Stateless
What’s serverless?

5. What are managed services?
ML & AI
Compute
Database &
Storage
Data Analytics
Smart
assistants &
chat
DevOps
Messaging

6. Cloud Functions
What’s serverless compute?
App Engine
Cloud Run
Compute

7. Simple dev
experience
Auto-scales
with usage
Response
to events
Pay only
while your code
runs
Cloud Functions: Event driven

8. Zero config deployments
gcloud app deploy
Pay only
while your code runs
Auto-scaling
to support peak traffic spikes
App Engine: HTTP driven platform

9. Auto-scaling
to support peak
traffic spikes
Cloud Run: Serverless container
Compliant with
Knative
Container to
production in
seconds

10. Cloud
Functions

11. No devops
experience needed
Write a function
and deploy
The easiest way to run
custom code and extend
Google Cloud products
Cloud Functions
01
02
Connect Google
Cloud services
03

12. Extending Google Cloud
products
Meet your business needs by adding
custom logic to extend Google Cloud
products like BigQuery, Cloud Storage
and Firestore.
Processing data
Transform data in as it arrives and store
it in a data store.
Perform image analysis and add
classification information to your
database.
Responding to events
Respond to events from Google Cloud
products like Cloud Storage.
Build endpoints for webhooks for 3rd
party services like GitHub.
Cloud Functions
When to use Cloud Functions

13. More events
Enables connecting more Google Cloud
and third party products together.
Longer processing time
Enables new workloads which require
more processing time to complete.
Cloud Functions
The 2nd generation of Cloud Functions is
Generally Available
More compute power
Perfect for workloads that require more
CPU, memory or processing time.

14. Allocate more memory (up to 32 GiB) and CPU (up to 8 vCPU)
for your function.
Enables new workloads requiring more memory
or processing .
More compute power / Cloud Functions
4x more compute power
32 GiB

15. 6x longer processing time
Up to 60 minutes of processing time for HTTP triggered
functions.
Enables new workloads which require more processing time
to complete.
More compute power / Cloud Functions

16. More events / Cloud Functions
10x event sources
Supports 125+ Google Cloud event sources.
Supports extending capabilities for 10x more Google Cloud
products via audit logs.
Additional 3rd party events from 4 partners with more
coming.
Leverages the open source CloudEvent specification.

17. Easy rollbacks with 2nd
generation
A new revision is automatically created for each deployment.
You can roll back traffic to a prior revision.
Revisions also support gradually moving traffic
to the latest revision.
More control / Cloud Functions

18. BigQuery Remote Functions
Create BigQuery Remote Functions using Cloud Functions.
Allows integration with external APIs including Google Cloud
AI/ML and Vertex APIs.
Supports 7 languages including JavaScript, Python and Java.
CREATE FUNCTION `project`.`table`.`bq-function-name`(
input INT
) RETURNS BOOL
REMOTE WITH CONNECTION 'your-connection'
OPTIONS (endpoint = 'https://your-cloud-function-url');
More events / Cloud Functions

19. BigQuery Remote Functions - Demo
More events / Cloud Functions

20. Cloud Run

21. Cloud Run
Deploy and scale
applications fast and
securely in a fully
managed environment
Simple and
Automated
01
No infra
management
02
Developer Velocity
03

22. Cloud Run
Available in all 34 Google Cloud regions
Cloud Run is available
Future Google Cloud region
Doha
Melbourne
Delhi
Toronto
São Paulo
Oregon
Las Vegas
Salt Lake City
Los Angeles
Iowa*
Montréal
N. Virginia
S. Carolina
London
Netherlands
Belgium Frankfurt
Warsaw
Finland
Zurich
Mumbai
Singapore
Jakarta
Taiwan
Hong Kong
Tokyo
Osaka
Seoul
Sydney
Paris
Madrid
Milan
Santiago
Turin
Columbus
Berlin
Dammam
Dallas Tel Aviv

23. Websites and web
applications
Server-side rendered pages
Web applications
Streaming with WebSockets
Internal web applications
APIs and microservices
REST or GraphQL API
Private HTTP or gRPC microservices
Streaming data processing
Process queue messages
Event driven architecture
Cloud Run
When to use Cloud Run services

24. Cloud Run
Jobs Preview
Run containers to completion. Cron for the cloud
Now available in all Google Cloud regions.
200
When to use Cloud Run jobs
● Script or tool
● Scheduled scripts
● Batch data processing

25. Seven new features in Cloud Run
Software Delivery Shield
04
Security Recommendations
05
Cloud Deploy
06
Datadog integration
01
Health checks
02
CPU Boost
03
Integrations
07

26. Cloud Run #1
Datadog support
New official Datadog instrumentation support for Google Cloud Run
Collect logs, metrics and traces in real-time via in-container Agent.

27. Cloud Run #2
Health checks Preview
Startup probe
Determines if a container is ready to receive traffic.
Cloud Run default: TCP probe on $PORT
Liveness probe NEW
Determines if a container can still serve requests.
Use HTTP or gRPC
Examples:
● Recover from corrupted local state.
● Force restart after N minutes.
Startup Serving requests Shut down
Custom probes with health checks NEW
Use a TCP or HTTP probe
Examples:
● Wait for the complete startup of your app.
● Wait for an initial download.
Container
lifecycle
Probes
Startup
Cloud Run starts
a new container

28. Cloud Run #3
Improve scaling speed with Startup CPU Boost Preview
Startup Serving
Without boost
Startup Serving
With boost
Container startup time

29. Cloud Run #4
Software Delivery Shield Preview
Surface vulnerabilities and build provenance in Cloud Run
Security target level (SLSA: Supply chain Levels for Software Artifacts)
2
2

30. Cloud Run #5
Security
Recommendations Preview
New recommendations by Active Assist:
● Move API keys and passwords stored in environment
variables to secrets in Secret Manager.
● Use the built-in service identity rather than copying
credentials in the container.

31. Cloud Run #6
Cloud Deploy support Preview

32. Integrations Preview
Making common tasks easier
● Create and connect a Memorystore instance
● Add a global external HTTPS Load Balancer with a
custom domain and HTTPS
Cloud Run #7

33. Zone 1
Regional High Availability
Region
App
Engine
Cloud Run
Cloud
Functions
Zone 2
App
Engine
Cloud Run
Cloud
Functions
Zone 3
App
Engine
Cloud Run
Cloud
Functions
Natively regional high available!

34. Global High Availability
Cloud Run
Cloud Load
Balancing
Cloud Load
Balancing
Cloud Run
Cloud Run
Cloud Load
Balancing
● Anycast IP
App
Engine
Cloud
Functions
Cloud
Functions
Cloud Load
Balancing
Anycast IP
● Multiple backends
● Route to the closest
available region

35. Data space

36. Cloud
Spanner
Cloud
Bigtable
Datastream
Google’s native database engines
Google Cloud: The best place to run
your operational database workloads
Managed third-party database engines
Bare Metal
Solution
Cloud SQL New
AlloyDB
Memorystore
MySQL
PostgreSQL
SQL Server
Oracle
Redis
Memcached
Database Migration Service
Relational
In-memory Document Key Value
Cloud
Firestore

37. Cloud Spanner
Relational
ACID transactions,
SQL, Schemas
Horizontally scalable
Distributed RDBMS,
Near unlimited scale
Fully managed ++
Simplified administration,
Enterprise grade
99.999% uptime SLA
Automatic sharding
Superior price-performance
No maintenance downtime
Zero-touch global replication
Automatic failure recovery
RPO =0, RTO = 0
Online, unlimited scaling
Security and compliance
Strong external consistency
Spanner processes over 2 billion requests per second at peak
Spanner has more than 6 exabytes of data under management

38. AlloyDB for PostgreSQL
An open-source compatible database engine
ready for top-tier relational database workloads
Database Migration Service now supports
PostgreSQL to AlloyDB migrations
More than 4x faster
for transactional workloads than standard
PostgreSQL
More than 2x faster
for transactional workloads than Amazon’s
comparable service
Up to 100x faster
for analytical queries than open source
Preview
“We have been so delighted to try out the new AlloyDB for PostgreSQL service. With
AlloyDB, we have significantly increased throughput, with no application changes
to our PostgreSQL workloads. And since it's a managed service, our teams can spend
less time on database operations, and more time on value added tasks.
Sofian Hadiwijaya, CTO and Co-Founder, Warung Pintar

39. Dataplex
Intelligent data fabric that unifies your distributed data to help
automate data management and power analytics at scale.
Unified metadata across distributed data
Automatic data discovery, and metadata harvesting,
enriched with business context. Logically unify and
organize your data without any data movement.
Centralized security & governance
Central policy management, monitoring and auditing
for data authorization, retention, and classification.
Intelligent data management
Built-in AI-driven intelligence with data classification,
data quality, data lineage, and lifecycle
management.
Data
Warehouses
Data Lakes Data Marts Database
Unified Data Management and Governance
data catalog | quality | lifecycle | classification | security | lineage
Data Catalog
Now including

40. Metadata ingestion for databases
Auto-ingest metadata from Spanner, CloudSQL,
and Bigtable into Data Catalog.
Metadata ingestion for Looker
Auto-ingest metadata for dashboards, views,
looks, and explores in Looker
LookerNew
DLP
BigQuery
GCS
DPMS
Pub Sub
SpannerNew
BigtableNew
CloudSQLNew
Announcing
Automatic cataloging of data in
Databases and Looker
Preview available in Q1’23
Discover data with Business Context

41. Automatic data profiling and quality
Profile your data at scale and measure data quality for
completeness, accuracy, validity, and freshness of your
data. Auto-generate rules and run on a fully managed,
serverless platform.
Built-in remediation actions
Setup data quality thresholds and automatically quarantine
data that does not meet your quality bar.
End-to-end observability
Enable scheduled monitoring of your data, view contextual
metrics and built-in dashboard, and make key metrics
available to data producers, consumers, and stewards in
your organization.
Announcing
Automatic Data Profiling and Data Quality
Preview coming soon
Build trust in your data

42. Understand & trust
Easily understand where your data comes from
and the transformations it goes through with
built-in visualization
Impact & root cause analysis
Trace downstream impact and upstream causes as soon
as data issues are captured
Foundation for Compliance
Enable monitoring and auditing of various data
flows across your data landscape and serve as a
foundation to apply required compliance policies.
Announcing
Data Lineage
Automatically processed for GCP data
sources and extendible to 3rd party data
sources.
GA available in Q1’23
● Lineage for BigQuery - Preview now - GA in Q1’23.
● Lineage for Composer and Data Fusion - Preview available in Q1’23
● APIs to extend Lineage to other systems - GA in Q1’23
Build trust in your data

43. Thank you!
Cloud Run cloud.google.com/run
Cloud Function cloud.google.com/functions
App Engine cloud.google.com/appengine
Find me on :
Twitter @gblaquiere
Medium @guillaume-blaquiere
GitHub guillaumeblaquiere

44. www.ServerlessToronto.org
Reducing the gap between IT and Business needs