SlideShare a Scribd company logo
1 of 53
Download to read offline
GoogleCloudPlatformSolutions
forDevOpsEngineers
Márton Kodok / @martonkodok
Google Developer Expert at REEA.net - Targu Mures
March 2019 - Vilnius, Lithuania
● Geek. Hiker. Do-er.
● Among the Top3 romanians on Stackoverflow 130k reputation
● Google Developer Expert on Cloud technologies
● Crafting Web/Mobile backends at REEA.net
● BigQuery/Redis and database engine expert
● Active in mentoring and IT community
StackOverflow: pentium10
GitHub: pentium10
Slideshare: martonkodok
Twitter: @martonkodok
GCP Solutions for DevOps Engineers @martonkodok
About me
1. Application development in the Cloud
2. App Engine: Scale your apps seamlessly from zero to planet scale
3. Cloud Functions: your gateway to GCP Services
4. Google Stackdriver: Metrics, logging, alerting are a universal right!
5. BigQuery: federated data access warehouse
6. Doing hybrid cloud mixing on premise with cloud
7. Practical use cases
8. Qwiklabs
Agenda
GCP Solutions for DevOps Engineers @martonkodok
What’s so hard about traditional app development?
GCP Solutions for DevOps Engineers @martonkodok
User
Select
IaaS
OS
Setup
Containerization
Storage
Container
Orchestration
Networking
Monitoring
Logging
Testing
Dev
REEA.net uses GCP
Build on the same infrastructure
that powers Google
Google Cloud Platform (GCP)
Compute Big Data
BigQuery
Cloud
Dataflow
Cloud
Dataproc
Cloud
Datalab
Cloud
Pub/Sub
Genomics
Storage & Databases
Cloud
Storage
Cloud
Bigtable
Cloud
Datastore
Cloud SQL
Cloud
Spanner
Persistent
Disk
Machine Learning
Cloud Machine
Learning
Cloud
Vision API
Cloud
Speech API
Cloud Natural
Language API
Cloud
Translation
API
Cloud
Jobs API
Data
Studio
Cloud
Dataprep
Cloud Video
Intelligence
API
Advanced
Solutions Lab
Compute
Engine
App
Engine
Kubernetes
Engine
GPU
Cloud
Functions
Container-
Optimized OS
Identity & Security
Cloud IAM
Cloud Resource
Manager
Cloud Security
Scanner
Key
Management
Service
BeyondCorp
Data Loss
Prevention API
Identity-Aware
Proxy
Security Key
Enforcement
Internet of Things
Cloud IoT
Core
Transfer
Appliance
Google Cloud Platform (GCP)
Developer Tools
Cloud SDK
Cloud
Deployment
Manager
Cloud Source
Repositories
Cloud
Tools for
Android Studio
Cloud Tools
for IntelliJ
Cloud
Tools for
PowerShell
Cloud
Tools for
Visual Studio
Container
Registry
Google Plug-in
for Eclipse
Cloud Test
Lab
Networking
Virtual
Private Cloud
Cloud Load
Balancing
Cloud
CDN
Cloud
Interconnect
Cloud DNS
Cloud
Network
Cloud
External IP
Addresses
Cloud
Firewall Rules
Cloud
Routes
Cloud VPN
Cloud
Router
Dedicated
Interconnect
Container
Builder
Management Tools
Stackdriver Monitoring Logging
Error
Reporting
Trace
Debugger
Cloud
Deployment
Manager
Cloud
Console
Cloud
Shell
Cloud Mobile
App
Cloud
Billing API
Cloud
APIs
Profiler
Google sees serverless as
GCP Solutions for DevOps Engineers @martonkodok
Programming model
Focus on code
Event-driven
Stateless
Operational model Billing model
Pay for usageZero ops
Automatic scaling
Managed security
Dev Ops $
Serverless is more than a set of functions
GCP Solutions for DevOps Engineers @martonkodok
Cloud Dataflow Cloud Tasks
Cloud Storage
Cloud PubSub
Cloud Functions App Engine
BigQuery
Stackdriver
Meet Serverless
serverless data center depicted
GCP Solutions for DevOps Engineers @martonkodok
Serverless is about maximizing elasticity, cost
savings, and agility of cloud computing.
GCP Solutions for DevOps Engineers @martonkodok
Serverless types
GCP Solutions for DevOps Engineers @martonkodok
Platforms Triggered Code
App Engine - managed application platform
GCP Solutions for DevOps Engineers @martonkodok
API 2
Compute Engine
Virtual Machines
API 1
App Engine
Split App Versions
API 3
Container Engine
Kubernetes Services
Multiple
Clients
API Requests
Cloud Load
Balancing
● Scale your applications seamlessly from
zero to planet scale
● Automatically scales depending on your
application traffic
● Traffic Splitting (app versions, A/B tests,
incremental rollouts)
Best used:
● For HTTP services
● For existing applications
App Engine: Services and versions
GCP Solutions for DevOps Engineers @martonkodok
Application
Version
Service
Version
Instance Instance
Service
Version Version
Instance Instance
App Engine: Traffic splitting
GCP Solutions for DevOps Engineers @martonkodok
A/B testing and
Canary releasing
with a few clicks or
a single gcloud
command
App Engine: Runtimes
GCP Solutions for DevOps Engineers @martonkodok
Java 8 1.11
GCP Solutions for DevOps Engineers @martonkodok
Async message processing
Asynchronous task execution
GCP Solutions for DevOps Engineers @martonkodok
Cloud Tasks Cloud PubSub
Message queue system
Guaranteed at-least-once delivery
Future Scheduling
Will only be dispatched once on dups
Best used:
● For HTTP services
● For App Engine handlers
Deliver event data based on topics
Exactly-once processing
Build multi-cloud on premise, hybrid apps
Cross zone message replication
Best used:
● For large-scale ingestion of events, streams
● Topics, publish/subscribe patterns, IoT
Cloud Tasks - Message Queue systems
GCP Solutions for DevOps Engineers @martonkodok
Workers
Compute Engine
Static Content
Cloud Storage
Dynamic Content
Cloud SQL
Dynamic Content
Cloud Datastore
Front End App
App Engine
Autoscaling
Cloud
Tasks
Memcache
Batch App
App Engine
Autoscaling
Cloud Load
Balancing
Cloud
DNS
Workers
Compute Engine
Autoscaling
Task Queues
GCP Solutions for DevOps Engineers @martonkodok
Slides: https://www.slideshare.net/martonkodok
Title: Architectural Patterns - Message Queues
Push queues
● Put with delays
Pull queues
● Ability to “tag”
● Lease multiple eg: gameboard
updated, game id as tag.
Reduce request latency
GCP Solutions for DevOps Engineers @martonkodok
GCP Solutions for DevOps Engineers @martonkodok
Cloud Functions
Cloud Functions
ApplicationEvent Sourcing
Frontend
Platform Services
Metrics / Logs/
Streaming
Event
Triggered
Cloud
Functions
Triggered Code
GCP Solutions for DevOps Engineers @martonkodok
Result
GCP Solutions for DevOps Engineers @martonkodok
Unit: Function
Trigger: Events and HTTP
Best used:
● For Events & Async workloads
● For single-purpose microservices
Cloud Functions
Cloud Functions - Event-driven - FaaS
GCP Solutions for DevOps Engineers @martonkodok
● Simplest way to run your code in the cloud - just deploy
● Automatically scales, highly available and fault tolerant
● No servers to provision, manage, patch or update
● Pay only while your code runs
● Connects and extends cloud services (In alpha: Java)
● Node 8.11
● Support for async/await
● Python 3.7.1
● Flask microframework
● Go 1.11
● Familiar building blocks
Functions: your gateway to GCP Services
GCP Solutions for DevOps Engineers @martonkodok
Access 20+ Google services from GCF
BigQuery
Cloud
Pub/Sub
Cloud
Storage
Cloud
Bigtable
Cloud
Datastore
Cloud
Spanner
Cloud Machine
Learning
Cloud Vision
API
Cloud Speech
API
Cloud Natural
Language API
Cloud
Translation API
Stackdriver
Services
Applications
Firebase
APIs
Assistant
Cloud Functions Trigger
GCP Solutions for DevOps Engineers @martonkodok
Cloud Storage
Finalize/Create
Delete
Archive
Metadata Update
Cloud Pub/Sub
Topic
Compute Engine EAP
Instance
Instance Group
Autoscaler
Firewall
Set Labels
Cloud Functions Trigger
GCP Solutions for DevOps Engineers @martonkodok
BigQuery
Job create
Job complete
Firebase
Realtime DB change
Authentication
Remote config
Google Analytics log
Cloud Firestore
Create
Update
Write
Delete
Summary: When to use what
GCP Solutions for DevOps Engineers @martonkodok
App Engine
Unit of computing
is apps
HTTP
request/response
Large scalable
backends
Cloud Functions
Smallest unit of
computing
Event driven
architecture
Connect & extend
services
Serverless add-on
Run functions, apps
& containers on
GKE
Full portability of
your artifacts
Run on your own
cluster
Slice and dice your application any way you
think it makes sense to be more agile, to build
better apps that deliver value.
The unit of computing is yours to chose!
GCP Solutions for DevOps Engineers @martonkodok
GCP Solutions for DevOps Engineers @martonkodok
How I Learned How to Stop Worrying
and Dig Hosted Monitoring
GCP Solutions for DevOps Engineers @martonkodok
What to do for monitoring?
● In-house or hosted?
● Modern vs proven?
● Specialized or general?
● Paid vs free?
Let’s be honest:
● Not enough time
● Small environment
● More important work to do
● Everyone else is doing it
GCP Solutions for DevOps Engineers @martonkodok
Intelligent monitoring and management
for services, containers, applications, and
infrastructure.
● Works with GCP, AWS, on prem
● Logging, tracing, alerts
● Collectd agent
● Cost per resource
● Easy point and click alerting policy
● Debugger, Error reporting, profiler *free
● Uptime checks *free
Google Stackdriver
GCP Solutions for DevOps Engineers @martonkodok
Google Stackdriver: Uptime check (offered free)
● Check Type: HTTP, TCP
● Resource Type: URL, Instance, App Engine, Load Balancer
● Global Locations
● Custom Headers (encrypted)
● Authentication
● Whitelisted source IPs
● Alerting policy: Email, SMS, Slack, PagerDuty, Hipchat, Campfire, Webhooks
GCP Solutions for DevOps Engineers @martonkodok
Google Stackdriver: Uptime check
GCP Solutions for DevOps Engineers @martonkodok
Life of a log
GCP Solutions for DevOps Engineers @martonkodok
Google Stackdriver
Metrics, logging, alerting are a universal right!
GCP Solutions for DevOps Engineers @martonkodok
Analytics-as-a-Service - Data Warehouse in the Cloud
Scales into Petabytes on Managed Infrastructure - load up to 5TB large files
SQL 2011 + Javascript UDF (User Defined Functions)
Familiar DB Structure (table, columns, views, struct, nested, JSON)
Integrates with Google Sheets + Cloud Storage + Pub/Sub connectors
Decent pricing (storage: $20/TB cold: $10/TB,queries $5/TB) *March 2019
What is BigQuery?
GCP Solutions for DevOps Engineers @martonkodok
Architecting for The Cloud
BigQuery
On-Premises Servers
Pipelines
ETL
Engine
Event Sourcing
Frontend
Platform Services
Metrics / Logs/
Streaming
GCP Solutions for DevOps Engineers @martonkodok
BigQuery: federated data access warehouse
GCP Solutions for DevOps Engineers @martonkodok
Application & Presentation
Audit logs
Billing entries
Stackdriver
Firebase
Google
Marketing
Platform
Cloud
Dataflow
Cloud
Storage
Report & Share
Business Analysis
BI Interface
Data Studio 360
Analysis
Processing
ML
Frontend
Platform Services
Real-Time Events
Multiple Platforms
Database
SQL
“ Data needs to be processed in
multiple services.
How can we pipe to multiple places?
GCP Solutions for DevOps Engineers @martonkodok
Architecting for The Cloud
On-Premises Servers
Event Sourcing
Frontend
Platform Services
Analyze
Metrics / Logs/
Streaming
Cloud Storage
GCP Solutions for DevOps Engineers @martonkodok
Cloud
Dataflow
Process
BigQuery
Cloud SQL
Stream
Batch
Data
Studio
Third-Party
Tools
“ We have our app outside of GCP.
How can we use the benefits of BigQuery?
GCP Solutions for DevOps Engineers @martonkodok
Data Pipeline Integration at REEA.net
Analytics Backend
BigQuery
On-Premises Servers
Pipelines
FluentD
Event Sourcing
Frontend
Platform Services
Metrics / Logs/
Streaming
Development
Team
Report & Share
Business Analysis
Tools
Tableau
QlikView
Data Studio
Internal
Dashboard
Database
SQL
Application
ServersServers
Cloud Storage
archive
Load / Export
Replay
Standard
Devices
HTTPS
GCP Solutions for DevOps Engineers @martonkodok
Cloud
Functions
The following slides will present a sample Fluentd configuration to:
1. Transform a record
2. Copy event to multiple outputs
3. Store event data in File (for backup/log purposes)
4. Stream to BigQuery (for immediate analyses)
GCP Solutions for DevOps Engineers @martonkodok
<filter frontend.user.*>
@type record_transformer
</filter>
<match frontend.user.*>
@type copy
<store>
@type forest
subtype file
</store>
<store>
@type bigquery
</store>
…
</match>
Filter plugin mutates incoming data. Add/modify/delete
event data transform attributes without a code deploy.1
2
3
4
The copy output plugin copies events to multiple outputs.
File(s), multiple databases, DB engines.
Great to ship same event to multiple subsystems.
The Bigquery output plugin on the fly streams the event to
the BigQuery warehouse. No need to write integration.
Data is available immediately for querying.
Whenever needed other output plugins can be wired in:
Kafka, Google Cloud Storage output plugin.
GCP Solutions for DevOps Engineers @martonkodok
record_transformer copy file BigQuery
<filter frontend.user.*>
@type record_transformer
enable_ruby
remove_keys host
<record>
bq {"insert_id":"${uid}","host":"${host}",
"created":"${time.to_i}"}
avg ${record["total"] / record["count"]}
</record>
</filter>
syntax: Ruby, easy to use.
Great for:
- date transformation,
- quick normalizations,
- calculating something on the fly,
and store in clear log/analytics db
- renaming without code deploy.
1 2 3 4
GCP Solutions for DevOps Engineers @martonkodok
record_transformer copy file BigQuery
<match frontend.user.*>
@type copy
<store>
@type forest
subtype file
<template>
path /tank/storage/${tag}.*.log
time_slice_format %Y%m%d
</template>
</store>
</match>
1 2 3 4
GCP Solutions for DevOps Engineers @martonkodok
record_transformer copy file BigQuery
<match frontend.user.*>
@type bigquery
method insert
auth_method json_key
json_key /etc/td-agent/keys/key-31da042be48c.json
time_field timestamp
time_slice_format %Y%m%d
table user$%{time_slice}
ignore_unknown_values
schema_path /etc/td-agent/schema/user_login.json
</match>
1 2 3 4
Connector uses:
- JSON key auth file
- JSON table schema
Pro features:
- streaming to Partitioned tables
- ignore unknown values
(not reflected in schema)
GCP Solutions for DevOps Engineers @martonkodok
● SQL+JSON (big costs saving with partitioning/clustering)
● run raw ad-hoc queries (either by analysts/sales or Devs)
● ability to throw in / join all kind of data
● pricing model 1TB free every month
● no more throwing away-, expiring-, aggregating old data
● no provisioning/deploy
● no running out of resources
● no more focus on large scale execution plan
Our benefits using BigQuery
GCP Solutions for DevOps Engineers @martonkodok
Kubernetes Machine Learning Certification
Introductory
For GCP
newcomers
1 hour duration,
2 labs
Enroll in the Baseline: Infrastructure
Quest.
1. Kubernetes Engine: Qwik Start (lab)
(video) - Deploy a containerized
application with Kubernetes Engine.
2. IoT: Qwik Start (lab) - Learn about
GCP’s Cloud IoT Core service, where
almost any IoThing is possible!
Enroll in the Baseline: Data, ML, AI Quest.
1. Cloud ML Engine: Qwik Start (lab)
(video) - Train and deploy a TensorFlow
model to Cloud ML Engine.
2. Cloud Natural Language API: Qwik
Start (lab) - Perform sentiment analysis on
a block of text. For fun, paste in the last
email you sent!
Enroll in the Cloud Architecture Quest.
1. Stackdriver Qwik Start: Web UI (lab)
What’s up with your VM? Learn to install
monitoring and logging agents to collect
info about your GCP resources.
2. Getting Started with Cloud KMS (lab) -
Create your first KeyRing and CryptoKey
with GCP.
Experienced
Qwiklabs
alumni
1 hour, 2 labs
Enroll in the Kubernetes Quest.
1. Kubernetes Engine: Qwik Start (lab)
(video) - Deploy a containerized
application with Kubernetes Engine.
2. Intro to Docker (lab)
Are your containers running? Create,
run, and debug containers, then pull and
push images to and from Google
Container Registry.
Enroll in the Machine Learning APIs Quest.
1. Cloud ML Engine: Qwik Start (lab)
(video) - Train and deploy a TensorFlow
model to Cloud ML Engine.
2. Detect Labels, Faces, and Landmarks
in Images with the Cloud Vision API (lab)
- How do you feel about self-driving cars?
Learn what’s behind the AI making the
future possible.
Enroll in the Cloud Architecture Quest.
1. Stackdriver Qwik Start: Web UI (lab) -
What’s up with your VM? Learn to install
monitoring and logging agents to collect
info about your GCP resources.
2. Application Performance Management
(APM) with Stackdriver (lab) - Dig deeper
into Stackdriver with a problematic
environment - can you identify the issues?
Qwiklabs - Find Your Topic and Skill Level
GCP Solutions for DevOps Engineers @martonkodok
Thank you.
Slides available on: slideshare.net/martonkodok
Reea.net - Integrated web solutions driven by creativity to deliver
projects.

More Related Content

What's hot

Speeding up your team with GitOps
Speeding up your team with GitOpsSpeeding up your team with GitOps
Speeding up your team with GitOpsBrice Fernandes
 
ArgoCD Meetup PPT final.pdf
ArgoCD Meetup PPT final.pdfArgoCD Meetup PPT final.pdf
ArgoCD Meetup PPT final.pdfamanmakwana3
 
Introduction to kubernetes
Introduction to kubernetesIntroduction to kubernetes
Introduction to kubernetesRishabh Indoria
 
Introduction to CI/CD
Introduction to CI/CDIntroduction to CI/CD
Introduction to CI/CDHoang Le
 
Open shift 4 infra deep dive
Open shift 4    infra deep diveOpen shift 4    infra deep dive
Open shift 4 infra deep diveWinton Winton
 
CICD Pipeline Using Github Actions
CICD Pipeline Using Github ActionsCICD Pipeline Using Github Actions
CICD Pipeline Using Github ActionsKumar Shìvam
 
Google Kubernetes Engine (GKE) deep dive
Google Kubernetes Engine (GKE) deep diveGoogle Kubernetes Engine (GKE) deep dive
Google Kubernetes Engine (GKE) deep diveAkash Agrawal
 
Gitops: a new paradigm for software defined operations
Gitops: a new paradigm for software defined operationsGitops: a new paradigm for software defined operations
Gitops: a new paradigm for software defined operationsMariano Cunietti
 
DevOps with GitHub Actions
DevOps with GitHub ActionsDevOps with GitHub Actions
DevOps with GitHub ActionsNilesh Gule
 
Kubernetes & Google Kubernetes Engine (GKE)
Kubernetes & Google Kubernetes Engine (GKE)Kubernetes & Google Kubernetes Engine (GKE)
Kubernetes & Google Kubernetes Engine (GKE)Akash Agrawal
 
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShiftKubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShiftDevOps.com
 

What's hot (20)

Why to Cloud Native
Why to Cloud NativeWhy to Cloud Native
Why to Cloud Native
 
Speeding up your team with GitOps
Speeding up your team with GitOpsSpeeding up your team with GitOps
Speeding up your team with GitOps
 
ArgoCD Meetup PPT final.pdf
ArgoCD Meetup PPT final.pdfArgoCD Meetup PPT final.pdf
ArgoCD Meetup PPT final.pdf
 
Argocd up and running
Argocd up and runningArgocd up and running
Argocd up and running
 
CICD with Jenkins
CICD with JenkinsCICD with Jenkins
CICD with Jenkins
 
Kubernetes Basics
Kubernetes BasicsKubernetes Basics
Kubernetes Basics
 
CI/CD with GitHub Actions
CI/CD with GitHub ActionsCI/CD with GitHub Actions
CI/CD with GitHub Actions
 
Introduction to kubernetes
Introduction to kubernetesIntroduction to kubernetes
Introduction to kubernetes
 
Introduction to CI/CD
Introduction to CI/CDIntroduction to CI/CD
Introduction to CI/CD
 
Open shift 4 infra deep dive
Open shift 4    infra deep diveOpen shift 4    infra deep dive
Open shift 4 infra deep dive
 
CICD Pipeline Using Github Actions
CICD Pipeline Using Github ActionsCICD Pipeline Using Github Actions
CICD Pipeline Using Github Actions
 
Google Kubernetes Engine (GKE) deep dive
Google Kubernetes Engine (GKE) deep diveGoogle Kubernetes Engine (GKE) deep dive
Google Kubernetes Engine (GKE) deep dive
 
OpenShift Introduction
OpenShift IntroductionOpenShift Introduction
OpenShift Introduction
 
GCP-pde.pdf
GCP-pde.pdfGCP-pde.pdf
GCP-pde.pdf
 
Kubernetes Basics
Kubernetes BasicsKubernetes Basics
Kubernetes Basics
 
"DevOps > CI+CD "
"DevOps > CI+CD ""DevOps > CI+CD "
"DevOps > CI+CD "
 
Gitops: a new paradigm for software defined operations
Gitops: a new paradigm for software defined operationsGitops: a new paradigm for software defined operations
Gitops: a new paradigm for software defined operations
 
DevOps with GitHub Actions
DevOps with GitHub ActionsDevOps with GitHub Actions
DevOps with GitHub Actions
 
Kubernetes & Google Kubernetes Engine (GKE)
Kubernetes & Google Kubernetes Engine (GKE)Kubernetes & Google Kubernetes Engine (GKE)
Kubernetes & Google Kubernetes Engine (GKE)
 
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShiftKubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
 

Similar to Google Cloud Platform Solutions for DevOps Engineers

GDG DevFest Romania - Architecting for the Google Cloud Platform
GDG DevFest Romania - Architecting for the Google Cloud PlatformGDG DevFest Romania - Architecting for the Google Cloud Platform
GDG DevFest Romania - Architecting for the Google Cloud PlatformMárton Kodok
 
GCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native ArchitecturesGCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native Architecturesnine
 
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQueryCodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQueryMárton Kodok
 
Google App Engine Overview and Update
Google App Engine Overview and UpdateGoogle App Engine Overview and Update
Google App Engine Overview and UpdateChris Schalk
 
GDG Heraklion - Architecting for the Google Cloud Platform
GDG Heraklion - Architecting for the Google Cloud PlatformGDG Heraklion - Architecting for the Google Cloud Platform
GDG Heraklion - Architecting for the Google Cloud PlatformMárton Kodok
 
Cloud Native Application Integration With APIs
Cloud Native Application Integration With APIsCloud Native Application Integration With APIs
Cloud Native Application Integration With APIsNirmal Fernando
 
Back to the Future: Containerize Legacy Applications
Back to the Future: Containerize Legacy ApplicationsBack to the Future: Containerize Legacy Applications
Back to the Future: Containerize Legacy ApplicationsDocker, Inc.
 
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...MongoDB
 
What's new in App Engine and intro to App Engine for Business
What's new in App Engine and intro to App Engine for BusinessWhat's new in App Engine and intro to App Engine for Business
What's new in App Engine and intro to App Engine for BusinessChris Schalk
 
Continuous Lifecycle London 2018 Event Keynote
Continuous Lifecycle London 2018 Event KeynoteContinuous Lifecycle London 2018 Event Keynote
Continuous Lifecycle London 2018 Event KeynoteWeaveworks
 
Cloud-Native Progressive Delivery
Cloud-Native Progressive DeliveryCloud-Native Progressive Delivery
Cloud-Native Progressive DeliveryMatt Turner
 
DevOps Pipelines and Metrics Driven Feedback Loops
DevOps Pipelines and Metrics Driven Feedback LoopsDevOps Pipelines and Metrics Driven Feedback Loops
DevOps Pipelines and Metrics Driven Feedback LoopsAndreas Grabner
 
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...Gibran Badrulzaman
 
Challenges In Modern Application
Challenges In Modern ApplicationChallenges In Modern Application
Challenges In Modern ApplicationRahul Kumar Gupta
 
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...NETWAYS
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform UpdateIdo Green
 
Dev ops presentation
Dev ops presentationDev ops presentation
Dev ops presentationAhmed Kamel
 
Google Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data editionGoogle Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data editionDaniel Zivkovic
 

Similar to Google Cloud Platform Solutions for DevOps Engineers (20)

GDG DevFest Romania - Architecting for the Google Cloud Platform
GDG DevFest Romania - Architecting for the Google Cloud PlatformGDG DevFest Romania - Architecting for the Google Cloud Platform
GDG DevFest Romania - Architecting for the Google Cloud Platform
 
GCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native ArchitecturesGCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native Architectures
 
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQueryCodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery
CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery
 
Google App Engine Overview and Update
Google App Engine Overview and UpdateGoogle App Engine Overview and Update
Google App Engine Overview and Update
 
GDG Heraklion - Architecting for the Google Cloud Platform
GDG Heraklion - Architecting for the Google Cloud PlatformGDG Heraklion - Architecting for the Google Cloud Platform
GDG Heraklion - Architecting for the Google Cloud Platform
 
Cloud Native Application Integration With APIs
Cloud Native Application Integration With APIsCloud Native Application Integration With APIs
Cloud Native Application Integration With APIs
 
Back to the Future: Containerize Legacy Applications
Back to the Future: Containerize Legacy ApplicationsBack to the Future: Containerize Legacy Applications
Back to the Future: Containerize Legacy Applications
 
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...
MongoDB .local London 2019: Migrating a Monolith to MongoDB Atlas – Auto Trad...
 
Where should I run my code? Serverless, Containers, Virtual Machines and more
Where should I run my code? Serverless, Containers, Virtual Machines and moreWhere should I run my code? Serverless, Containers, Virtual Machines and more
Where should I run my code? Serverless, Containers, Virtual Machines and more
 
What's new in App Engine and intro to App Engine for Business
What's new in App Engine and intro to App Engine for BusinessWhat's new in App Engine and intro to App Engine for Business
What's new in App Engine and intro to App Engine for Business
 
Continuous Lifecycle London 2018 Event Keynote
Continuous Lifecycle London 2018 Event KeynoteContinuous Lifecycle London 2018 Event Keynote
Continuous Lifecycle London 2018 Event Keynote
 
Deep dive into serverless on Google Cloud
Deep dive into serverless on Google CloudDeep dive into serverless on Google Cloud
Deep dive into serverless on Google Cloud
 
Cloud-Native Progressive Delivery
Cloud-Native Progressive DeliveryCloud-Native Progressive Delivery
Cloud-Native Progressive Delivery
 
DevOps Pipelines and Metrics Driven Feedback Loops
DevOps Pipelines and Metrics Driven Feedback LoopsDevOps Pipelines and Metrics Driven Feedback Loops
DevOps Pipelines and Metrics Driven Feedback Loops
 
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...
Understanding the GitOps Workflow and CICD Pipeline - What It Is, Why It Matt...
 
Challenges In Modern Application
Challenges In Modern ApplicationChallenges In Modern Application
Challenges In Modern Application
 
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...
OSMC 2022 | Unifying Observability Weaving Prometheus, Jaeger, and Open Sourc...
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform Update
 
Dev ops presentation
Dev ops presentationDev ops presentation
Dev ops presentation
 
Google Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data editionGoogle Cloud Next '22 Recap: Serverless & Data edition
Google Cloud Next '22 Recap: Serverless & Data edition
 

More from Márton Kodok

Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionGen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionMárton Kodok
 
DevBCN Vertex AI - Pipelines for your MLOps workflows
DevBCN Vertex AI - Pipelines for your MLOps workflowsDevBCN Vertex AI - Pipelines for your MLOps workflows
DevBCN Vertex AI - Pipelines for your MLOps workflowsMárton Kodok
 
Discover BigQuery ML, build your own CREATE MODEL statement
Discover BigQuery ML, build your own CREATE MODEL statementDiscover BigQuery ML, build your own CREATE MODEL statement
Discover BigQuery ML, build your own CREATE MODEL statementMárton Kodok
 
Cloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationCloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationMárton Kodok
 
BigQuery best practices and recommendations to reduce costs with BI Engine, S...
BigQuery best practices and recommendations to reduce costs with BI Engine, S...BigQuery best practices and recommendations to reduce costs with BI Engine, S...
BigQuery best practices and recommendations to reduce costs with BI Engine, S...Márton Kodok
 
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google CloudVertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google CloudMárton Kodok
 
Vertex AI: Pipelines for your MLOps workflows
Vertex AI: Pipelines for your MLOps workflowsVertex AI: Pipelines for your MLOps workflows
Vertex AI: Pipelines for your MLOps workflowsMárton Kodok
 
Cloud Workflows What's new in serverless orchestration and automation
Cloud Workflows What's new in serverless orchestration and automationCloud Workflows What's new in serverless orchestration and automation
Cloud Workflows What's new in serverless orchestration and automationMárton Kodok
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsMárton Kodok
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsMárton Kodok
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsMárton Kodok
 
BigdataConference Europe - BigQuery ML
BigdataConference Europe - BigQuery MLBigdataConference Europe - BigQuery ML
BigdataConference Europe - BigQuery MLMárton Kodok
 
DevFest Romania 2020 Keynote: Bringing the Cloud to you.
DevFest Romania 2020 Keynote: Bringing the Cloud to you.DevFest Romania 2020 Keynote: Bringing the Cloud to you.
DevFest Romania 2020 Keynote: Bringing the Cloud to you.Márton Kodok
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLMárton Kodok
 
Applying BigQuery ML on e-commerce data analytics
Applying BigQuery ML on e-commerce data analyticsApplying BigQuery ML on e-commerce data analytics
Applying BigQuery ML on e-commerce data analyticsMárton Kodok
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQueryMárton Kodok
 
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer Expertig
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer ExpertigVibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer Expertig
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer ExpertigMárton Kodok
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLMárton Kodok
 
Next18 Extended Targu Mures - Bringing the Cloud to you
Next18 Extended Targu Mures - Bringing the Cloud to youNext18 Extended Targu Mures - Bringing the Cloud to you
Next18 Extended Targu Mures - Bringing the Cloud to youMárton Kodok
 
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud PlatformonMárton Kodok
 

More from Márton Kodok (20)

Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionGen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
 
DevBCN Vertex AI - Pipelines for your MLOps workflows
DevBCN Vertex AI - Pipelines for your MLOps workflowsDevBCN Vertex AI - Pipelines for your MLOps workflows
DevBCN Vertex AI - Pipelines for your MLOps workflows
 
Discover BigQuery ML, build your own CREATE MODEL statement
Discover BigQuery ML, build your own CREATE MODEL statementDiscover BigQuery ML, build your own CREATE MODEL statement
Discover BigQuery ML, build your own CREATE MODEL statement
 
Cloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationCloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerization
 
BigQuery best practices and recommendations to reduce costs with BI Engine, S...
BigQuery best practices and recommendations to reduce costs with BI Engine, S...BigQuery best practices and recommendations to reduce costs with BI Engine, S...
BigQuery best practices and recommendations to reduce costs with BI Engine, S...
 
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google CloudVertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
 
Vertex AI: Pipelines for your MLOps workflows
Vertex AI: Pipelines for your MLOps workflowsVertex AI: Pipelines for your MLOps workflows
Vertex AI: Pipelines for your MLOps workflows
 
Cloud Workflows What's new in serverless orchestration and automation
Cloud Workflows What's new in serverless orchestration and automationCloud Workflows What's new in serverless orchestration and automation
Cloud Workflows What's new in serverless orchestration and automation
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud Workflows
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud Workflows
 
Serverless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud WorkflowsServerless orchestration and automation with Cloud Workflows
Serverless orchestration and automation with Cloud Workflows
 
BigdataConference Europe - BigQuery ML
BigdataConference Europe - BigQuery MLBigdataConference Europe - BigQuery ML
BigdataConference Europe - BigQuery ML
 
DevFest Romania 2020 Keynote: Bringing the Cloud to you.
DevFest Romania 2020 Keynote: Bringing the Cloud to you.DevFest Romania 2020 Keynote: Bringing the Cloud to you.
DevFest Romania 2020 Keynote: Bringing the Cloud to you.
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQL
 
Applying BigQuery ML on e-commerce data analytics
Applying BigQuery ML on e-commerce data analyticsApplying BigQuery ML on e-commerce data analytics
Applying BigQuery ML on e-commerce data analytics
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuery
 
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer Expertig
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer ExpertigVibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer Expertig
Vibe Koli 2019 - Utazás az egyetem padjaitól a Google Developer Expertig
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQL
 
Next18 Extended Targu Mures - Bringing the Cloud to you
Next18 Extended Targu Mures - Bringing the Cloud to youNext18 Extended Targu Mures - Bringing the Cloud to you
Next18 Extended Targu Mures - Bringing the Cloud to you
 
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
 

Recently uploaded

GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jNeo4j
 
Mastering Project Planning with Microsoft Project 2016.pptx
Mastering Project Planning with Microsoft Project 2016.pptxMastering Project Planning with Microsoft Project 2016.pptx
Mastering Project Planning with Microsoft Project 2016.pptxAS Design & AST.
 
What is Mendix and the concept of low-code development.docx
What is Mendix and the concept of low-code development.docxWhat is Mendix and the concept of low-code development.docx
What is Mendix and the concept of low-code development.docxTechnogeeks
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...kalichargn70th171
 
SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?Alexandre Beguel
 
Tech Tuesday Slides - Getting Started with the Portfolio Module.
Tech Tuesday Slides - Getting Started with the Portfolio Module.Tech Tuesday Slides - Getting Started with the Portfolio Module.
Tech Tuesday Slides - Getting Started with the Portfolio Module.OnePlan Solutions
 
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...OnePlan Solutions
 
Revolutionize Your Video Editing with InVideo.io: A Comprehensive Review
Revolutionize Your Video Editing with InVideo.io: A Comprehensive ReviewRevolutionize Your Video Editing with InVideo.io: A Comprehensive Review
Revolutionize Your Video Editing with InVideo.io: A Comprehensive Reviewjw364beach
 
Key Steps in Agile Software Delivery Roadmap
Key Steps in Agile Software Delivery RoadmapKey Steps in Agile Software Delivery Roadmap
Key Steps in Agile Software Delivery RoadmapIshara Amarasekera
 
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdfAndrey Devyatkin
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flinkconfluent
 
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...Bert Jan Schrijver
 
logical backup of Oracle Datapump-detailed.pptx
logical backup of Oracle Datapump-detailed.pptxlogical backup of Oracle Datapump-detailed.pptx
logical backup of Oracle Datapump-detailed.pptxRemote DBA Services
 
oracle 23c new features for developer and dba
oracle 23c new features for developer and dbaoracle 23c new features for developer and dba
oracle 23c new features for developer and dbaRemote DBA Services
 
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...Bert Jan Schrijver
 
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...Milind Agarwal
 
The State of the Green IT at the beginning of 2024
The State of the Green IT at the beginning of 2024The State of the Green IT at the beginning of 2024
The State of the Green IT at the beginning of 2024Artur Skowroński
 
Preparing BitVisor for Supporting Multiple Architectures
Preparing BitVisor for Supporting Multiple ArchitecturesPreparing BitVisor for Supporting Multiple Architectures
Preparing BitVisor for Supporting Multiple ArchitecturesAke Koomsin
 
full course of software engineering mid term.pdf
full course of software engineering mid term.pdffull course of software engineering mid term.pdf
full course of software engineering mid term.pdfAbdul salam
 
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...Piyovi
 

Recently uploaded (20)

GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
 
Mastering Project Planning with Microsoft Project 2016.pptx
Mastering Project Planning with Microsoft Project 2016.pptxMastering Project Planning with Microsoft Project 2016.pptx
Mastering Project Planning with Microsoft Project 2016.pptx
 
What is Mendix and the concept of low-code development.docx
What is Mendix and the concept of low-code development.docxWhat is Mendix and the concept of low-code development.docx
What is Mendix and the concept of low-code development.docx
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
 
SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?
 
Tech Tuesday Slides - Getting Started with the Portfolio Module.
Tech Tuesday Slides - Getting Started with the Portfolio Module.Tech Tuesday Slides - Getting Started with the Portfolio Module.
Tech Tuesday Slides - Getting Started with the Portfolio Module.
 
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...
Transform your Corporate Strategy Office - Harness OnePlan’s Strategic Portfo...
 
Revolutionize Your Video Editing with InVideo.io: A Comprehensive Review
Revolutionize Your Video Editing with InVideo.io: A Comprehensive ReviewRevolutionize Your Video Editing with InVideo.io: A Comprehensive Review
Revolutionize Your Video Editing with InVideo.io: A Comprehensive Review
 
Key Steps in Agile Software Delivery Roadmap
Key Steps in Agile Software Delivery RoadmapKey Steps in Agile Software Delivery Roadmap
Key Steps in Agile Software Delivery Roadmap
 
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...
AmsterdamJUG April 2024 - Going serverless with Quarkus GraalVM native images...
 
logical backup of Oracle Datapump-detailed.pptx
logical backup of Oracle Datapump-detailed.pptxlogical backup of Oracle Datapump-detailed.pptx
logical backup of Oracle Datapump-detailed.pptx
 
oracle 23c new features for developer and dba
oracle 23c new features for developer and dbaoracle 23c new features for developer and dba
oracle 23c new features for developer and dba
 
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
 
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...
Leveraging the Expertise of a Social Media Fraud Analyst to Safeguard Brand R...
 
The State of the Green IT at the beginning of 2024
The State of the Green IT at the beginning of 2024The State of the Green IT at the beginning of 2024
The State of the Green IT at the beginning of 2024
 
Preparing BitVisor for Supporting Multiple Architectures
Preparing BitVisor for Supporting Multiple ArchitecturesPreparing BitVisor for Supporting Multiple Architectures
Preparing BitVisor for Supporting Multiple Architectures
 
full course of software engineering mid term.pdf
full course of software engineering mid term.pdffull course of software engineering mid term.pdf
full course of software engineering mid term.pdf
 
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...
Explore the Three Main Types of Logistics - Inbound Logistics, Outbound Logis...
 

Google Cloud Platform Solutions for DevOps Engineers

  • 1. GoogleCloudPlatformSolutions forDevOpsEngineers Márton Kodok / @martonkodok Google Developer Expert at REEA.net - Targu Mures March 2019 - Vilnius, Lithuania
  • 2. ● Geek. Hiker. Do-er. ● Among the Top3 romanians on Stackoverflow 130k reputation ● Google Developer Expert on Cloud technologies ● Crafting Web/Mobile backends at REEA.net ● BigQuery/Redis and database engine expert ● Active in mentoring and IT community StackOverflow: pentium10 GitHub: pentium10 Slideshare: martonkodok Twitter: @martonkodok GCP Solutions for DevOps Engineers @martonkodok About me
  • 3. 1. Application development in the Cloud 2. App Engine: Scale your apps seamlessly from zero to planet scale 3. Cloud Functions: your gateway to GCP Services 4. Google Stackdriver: Metrics, logging, alerting are a universal right! 5. BigQuery: federated data access warehouse 6. Doing hybrid cloud mixing on premise with cloud 7. Practical use cases 8. Qwiklabs Agenda GCP Solutions for DevOps Engineers @martonkodok
  • 4. What’s so hard about traditional app development? GCP Solutions for DevOps Engineers @martonkodok User Select IaaS OS Setup Containerization Storage Container Orchestration Networking Monitoring Logging Testing Dev
  • 5. REEA.net uses GCP Build on the same infrastructure that powers Google
  • 6. Google Cloud Platform (GCP) Compute Big Data BigQuery Cloud Dataflow Cloud Dataproc Cloud Datalab Cloud Pub/Sub Genomics Storage & Databases Cloud Storage Cloud Bigtable Cloud Datastore Cloud SQL Cloud Spanner Persistent Disk Machine Learning Cloud Machine Learning Cloud Vision API Cloud Speech API Cloud Natural Language API Cloud Translation API Cloud Jobs API Data Studio Cloud Dataprep Cloud Video Intelligence API Advanced Solutions Lab Compute Engine App Engine Kubernetes Engine GPU Cloud Functions Container- Optimized OS Identity & Security Cloud IAM Cloud Resource Manager Cloud Security Scanner Key Management Service BeyondCorp Data Loss Prevention API Identity-Aware Proxy Security Key Enforcement Internet of Things Cloud IoT Core Transfer Appliance
  • 7. Google Cloud Platform (GCP) Developer Tools Cloud SDK Cloud Deployment Manager Cloud Source Repositories Cloud Tools for Android Studio Cloud Tools for IntelliJ Cloud Tools for PowerShell Cloud Tools for Visual Studio Container Registry Google Plug-in for Eclipse Cloud Test Lab Networking Virtual Private Cloud Cloud Load Balancing Cloud CDN Cloud Interconnect Cloud DNS Cloud Network Cloud External IP Addresses Cloud Firewall Rules Cloud Routes Cloud VPN Cloud Router Dedicated Interconnect Container Builder Management Tools Stackdriver Monitoring Logging Error Reporting Trace Debugger Cloud Deployment Manager Cloud Console Cloud Shell Cloud Mobile App Cloud Billing API Cloud APIs Profiler
  • 8. Google sees serverless as GCP Solutions for DevOps Engineers @martonkodok Programming model Focus on code Event-driven Stateless Operational model Billing model Pay for usageZero ops Automatic scaling Managed security Dev Ops $
  • 9. Serverless is more than a set of functions GCP Solutions for DevOps Engineers @martonkodok Cloud Dataflow Cloud Tasks Cloud Storage Cloud PubSub Cloud Functions App Engine BigQuery Stackdriver
  • 10. Meet Serverless serverless data center depicted GCP Solutions for DevOps Engineers @martonkodok
  • 11. Serverless is about maximizing elasticity, cost savings, and agility of cloud computing. GCP Solutions for DevOps Engineers @martonkodok
  • 12. Serverless types GCP Solutions for DevOps Engineers @martonkodok Platforms Triggered Code
  • 13. App Engine - managed application platform GCP Solutions for DevOps Engineers @martonkodok API 2 Compute Engine Virtual Machines API 1 App Engine Split App Versions API 3 Container Engine Kubernetes Services Multiple Clients API Requests Cloud Load Balancing ● Scale your applications seamlessly from zero to planet scale ● Automatically scales depending on your application traffic ● Traffic Splitting (app versions, A/B tests, incremental rollouts) Best used: ● For HTTP services ● For existing applications
  • 14. App Engine: Services and versions GCP Solutions for DevOps Engineers @martonkodok Application Version Service Version Instance Instance Service Version Version Instance Instance
  • 15. App Engine: Traffic splitting GCP Solutions for DevOps Engineers @martonkodok A/B testing and Canary releasing with a few clicks or a single gcloud command
  • 16. App Engine: Runtimes GCP Solutions for DevOps Engineers @martonkodok Java 8 1.11
  • 17. GCP Solutions for DevOps Engineers @martonkodok Async message processing
  • 18. Asynchronous task execution GCP Solutions for DevOps Engineers @martonkodok Cloud Tasks Cloud PubSub Message queue system Guaranteed at-least-once delivery Future Scheduling Will only be dispatched once on dups Best used: ● For HTTP services ● For App Engine handlers Deliver event data based on topics Exactly-once processing Build multi-cloud on premise, hybrid apps Cross zone message replication Best used: ● For large-scale ingestion of events, streams ● Topics, publish/subscribe patterns, IoT
  • 19. Cloud Tasks - Message Queue systems GCP Solutions for DevOps Engineers @martonkodok Workers Compute Engine Static Content Cloud Storage Dynamic Content Cloud SQL Dynamic Content Cloud Datastore Front End App App Engine Autoscaling Cloud Tasks Memcache Batch App App Engine Autoscaling Cloud Load Balancing Cloud DNS Workers Compute Engine Autoscaling
  • 20. Task Queues GCP Solutions for DevOps Engineers @martonkodok Slides: https://www.slideshare.net/martonkodok Title: Architectural Patterns - Message Queues Push queues ● Put with delays Pull queues ● Ability to “tag” ● Lease multiple eg: gameboard updated, game id as tag.
  • 21. Reduce request latency GCP Solutions for DevOps Engineers @martonkodok
  • 22. GCP Solutions for DevOps Engineers @martonkodok Cloud Functions
  • 23. Cloud Functions ApplicationEvent Sourcing Frontend Platform Services Metrics / Logs/ Streaming Event Triggered Cloud Functions Triggered Code GCP Solutions for DevOps Engineers @martonkodok Result
  • 24. GCP Solutions for DevOps Engineers @martonkodok Unit: Function Trigger: Events and HTTP Best used: ● For Events & Async workloads ● For single-purpose microservices Cloud Functions
  • 25. Cloud Functions - Event-driven - FaaS GCP Solutions for DevOps Engineers @martonkodok ● Simplest way to run your code in the cloud - just deploy ● Automatically scales, highly available and fault tolerant ● No servers to provision, manage, patch or update ● Pay only while your code runs ● Connects and extends cloud services (In alpha: Java) ● Node 8.11 ● Support for async/await ● Python 3.7.1 ● Flask microframework ● Go 1.11 ● Familiar building blocks
  • 26. Functions: your gateway to GCP Services GCP Solutions for DevOps Engineers @martonkodok Access 20+ Google services from GCF BigQuery Cloud Pub/Sub Cloud Storage Cloud Bigtable Cloud Datastore Cloud Spanner Cloud Machine Learning Cloud Vision API Cloud Speech API Cloud Natural Language API Cloud Translation API Stackdriver Services Applications Firebase APIs Assistant
  • 27. Cloud Functions Trigger GCP Solutions for DevOps Engineers @martonkodok Cloud Storage Finalize/Create Delete Archive Metadata Update Cloud Pub/Sub Topic Compute Engine EAP Instance Instance Group Autoscaler Firewall Set Labels
  • 28. Cloud Functions Trigger GCP Solutions for DevOps Engineers @martonkodok BigQuery Job create Job complete Firebase Realtime DB change Authentication Remote config Google Analytics log Cloud Firestore Create Update Write Delete
  • 29. Summary: When to use what GCP Solutions for DevOps Engineers @martonkodok App Engine Unit of computing is apps HTTP request/response Large scalable backends Cloud Functions Smallest unit of computing Event driven architecture Connect & extend services Serverless add-on Run functions, apps & containers on GKE Full portability of your artifacts Run on your own cluster
  • 30. Slice and dice your application any way you think it makes sense to be more agile, to build better apps that deliver value. The unit of computing is yours to chose! GCP Solutions for DevOps Engineers @martonkodok
  • 31. GCP Solutions for DevOps Engineers @martonkodok How I Learned How to Stop Worrying and Dig Hosted Monitoring
  • 32. GCP Solutions for DevOps Engineers @martonkodok What to do for monitoring? ● In-house or hosted? ● Modern vs proven? ● Specialized or general? ● Paid vs free? Let’s be honest: ● Not enough time ● Small environment ● More important work to do ● Everyone else is doing it
  • 33. GCP Solutions for DevOps Engineers @martonkodok Intelligent monitoring and management for services, containers, applications, and infrastructure. ● Works with GCP, AWS, on prem ● Logging, tracing, alerts ● Collectd agent ● Cost per resource ● Easy point and click alerting policy ● Debugger, Error reporting, profiler *free ● Uptime checks *free Google Stackdriver
  • 34. GCP Solutions for DevOps Engineers @martonkodok Google Stackdriver: Uptime check (offered free) ● Check Type: HTTP, TCP ● Resource Type: URL, Instance, App Engine, Load Balancer ● Global Locations ● Custom Headers (encrypted) ● Authentication ● Whitelisted source IPs ● Alerting policy: Email, SMS, Slack, PagerDuty, Hipchat, Campfire, Webhooks
  • 35. GCP Solutions for DevOps Engineers @martonkodok Google Stackdriver: Uptime check
  • 36. GCP Solutions for DevOps Engineers @martonkodok Life of a log
  • 37. GCP Solutions for DevOps Engineers @martonkodok Google Stackdriver Metrics, logging, alerting are a universal right!
  • 38. GCP Solutions for DevOps Engineers @martonkodok
  • 39. Analytics-as-a-Service - Data Warehouse in the Cloud Scales into Petabytes on Managed Infrastructure - load up to 5TB large files SQL 2011 + Javascript UDF (User Defined Functions) Familiar DB Structure (table, columns, views, struct, nested, JSON) Integrates with Google Sheets + Cloud Storage + Pub/Sub connectors Decent pricing (storage: $20/TB cold: $10/TB,queries $5/TB) *March 2019 What is BigQuery? GCP Solutions for DevOps Engineers @martonkodok
  • 40. Architecting for The Cloud BigQuery On-Premises Servers Pipelines ETL Engine Event Sourcing Frontend Platform Services Metrics / Logs/ Streaming GCP Solutions for DevOps Engineers @martonkodok
  • 41. BigQuery: federated data access warehouse GCP Solutions for DevOps Engineers @martonkodok Application & Presentation Audit logs Billing entries Stackdriver Firebase Google Marketing Platform Cloud Dataflow Cloud Storage Report & Share Business Analysis BI Interface Data Studio 360 Analysis Processing ML Frontend Platform Services Real-Time Events Multiple Platforms Database SQL
  • 42. “ Data needs to be processed in multiple services. How can we pipe to multiple places? GCP Solutions for DevOps Engineers @martonkodok
  • 43. Architecting for The Cloud On-Premises Servers Event Sourcing Frontend Platform Services Analyze Metrics / Logs/ Streaming Cloud Storage GCP Solutions for DevOps Engineers @martonkodok Cloud Dataflow Process BigQuery Cloud SQL Stream Batch Data Studio Third-Party Tools
  • 44. “ We have our app outside of GCP. How can we use the benefits of BigQuery? GCP Solutions for DevOps Engineers @martonkodok
  • 45. Data Pipeline Integration at REEA.net Analytics Backend BigQuery On-Premises Servers Pipelines FluentD Event Sourcing Frontend Platform Services Metrics / Logs/ Streaming Development Team Report & Share Business Analysis Tools Tableau QlikView Data Studio Internal Dashboard Database SQL Application ServersServers Cloud Storage archive Load / Export Replay Standard Devices HTTPS GCP Solutions for DevOps Engineers @martonkodok Cloud Functions
  • 46. The following slides will present a sample Fluentd configuration to: 1. Transform a record 2. Copy event to multiple outputs 3. Store event data in File (for backup/log purposes) 4. Stream to BigQuery (for immediate analyses) GCP Solutions for DevOps Engineers @martonkodok
  • 47. <filter frontend.user.*> @type record_transformer </filter> <match frontend.user.*> @type copy <store> @type forest subtype file </store> <store> @type bigquery </store> … </match> Filter plugin mutates incoming data. Add/modify/delete event data transform attributes without a code deploy.1 2 3 4 The copy output plugin copies events to multiple outputs. File(s), multiple databases, DB engines. Great to ship same event to multiple subsystems. The Bigquery output plugin on the fly streams the event to the BigQuery warehouse. No need to write integration. Data is available immediately for querying. Whenever needed other output plugins can be wired in: Kafka, Google Cloud Storage output plugin. GCP Solutions for DevOps Engineers @martonkodok
  • 48. record_transformer copy file BigQuery <filter frontend.user.*> @type record_transformer enable_ruby remove_keys host <record> bq {"insert_id":"${uid}","host":"${host}", "created":"${time.to_i}"} avg ${record["total"] / record["count"]} </record> </filter> syntax: Ruby, easy to use. Great for: - date transformation, - quick normalizations, - calculating something on the fly, and store in clear log/analytics db - renaming without code deploy. 1 2 3 4 GCP Solutions for DevOps Engineers @martonkodok
  • 49. record_transformer copy file BigQuery <match frontend.user.*> @type copy <store> @type forest subtype file <template> path /tank/storage/${tag}.*.log time_slice_format %Y%m%d </template> </store> </match> 1 2 3 4 GCP Solutions for DevOps Engineers @martonkodok
  • 50. record_transformer copy file BigQuery <match frontend.user.*> @type bigquery method insert auth_method json_key json_key /etc/td-agent/keys/key-31da042be48c.json time_field timestamp time_slice_format %Y%m%d table user$%{time_slice} ignore_unknown_values schema_path /etc/td-agent/schema/user_login.json </match> 1 2 3 4 Connector uses: - JSON key auth file - JSON table schema Pro features: - streaming to Partitioned tables - ignore unknown values (not reflected in schema) GCP Solutions for DevOps Engineers @martonkodok
  • 51. ● SQL+JSON (big costs saving with partitioning/clustering) ● run raw ad-hoc queries (either by analysts/sales or Devs) ● ability to throw in / join all kind of data ● pricing model 1TB free every month ● no more throwing away-, expiring-, aggregating old data ● no provisioning/deploy ● no running out of resources ● no more focus on large scale execution plan Our benefits using BigQuery GCP Solutions for DevOps Engineers @martonkodok
  • 52. Kubernetes Machine Learning Certification Introductory For GCP newcomers 1 hour duration, 2 labs Enroll in the Baseline: Infrastructure Quest. 1. Kubernetes Engine: Qwik Start (lab) (video) - Deploy a containerized application with Kubernetes Engine. 2. IoT: Qwik Start (lab) - Learn about GCP’s Cloud IoT Core service, where almost any IoThing is possible! Enroll in the Baseline: Data, ML, AI Quest. 1. Cloud ML Engine: Qwik Start (lab) (video) - Train and deploy a TensorFlow model to Cloud ML Engine. 2. Cloud Natural Language API: Qwik Start (lab) - Perform sentiment analysis on a block of text. For fun, paste in the last email you sent! Enroll in the Cloud Architecture Quest. 1. Stackdriver Qwik Start: Web UI (lab) What’s up with your VM? Learn to install monitoring and logging agents to collect info about your GCP resources. 2. Getting Started with Cloud KMS (lab) - Create your first KeyRing and CryptoKey with GCP. Experienced Qwiklabs alumni 1 hour, 2 labs Enroll in the Kubernetes Quest. 1. Kubernetes Engine: Qwik Start (lab) (video) - Deploy a containerized application with Kubernetes Engine. 2. Intro to Docker (lab) Are your containers running? Create, run, and debug containers, then pull and push images to and from Google Container Registry. Enroll in the Machine Learning APIs Quest. 1. Cloud ML Engine: Qwik Start (lab) (video) - Train and deploy a TensorFlow model to Cloud ML Engine. 2. Detect Labels, Faces, and Landmarks in Images with the Cloud Vision API (lab) - How do you feel about self-driving cars? Learn what’s behind the AI making the future possible. Enroll in the Cloud Architecture Quest. 1. Stackdriver Qwik Start: Web UI (lab) - What’s up with your VM? Learn to install monitoring and logging agents to collect info about your GCP resources. 2. Application Performance Management (APM) with Stackdriver (lab) - Dig deeper into Stackdriver with a problematic environment - can you identify the issues? Qwiklabs - Find Your Topic and Skill Level GCP Solutions for DevOps Engineers @martonkodok
  • 53. Thank you. Slides available on: slideshare.net/martonkodok Reea.net - Integrated web solutions driven by creativity to deliver projects.