Cloud Native Application Development - build fast, low TCO, scalable & agile software on Oracle Cloud (APAC Oracle Groundbreaker Tour 2021, november 2021)

Cloud Native
Application
Development
build fast, low TCO,
scalable & agile
software
on Oracle Cloud
Oracle Groundbreakers APAC Virtual Tour 2021, 26th November
Lucas Jellema, CTO & Architect AMIS | Conclusion

Publiek
Castle on the Cloud – Physical Foundation

Publiek
Castle on the Cloud – Physical Foundation
power cooling
rackspace
real estate

Publiek
Castle on the Cloud – Security Foundation
power cooling
rack
space
physical real estate
• Security
• digital & physical protection and monitoring
• zones: Fault Domains, Availability Domains, Regions
• offline, off-site archives

Publiek
Castle on the Cloud – Infrastructure (real)
power cooling
rack
space
• Servers
• Storage
• Network
• Staff: acquisition, training, installation, monitoring, patching/upgrading/replacing

Publiek
Castle on the Cloud – Cloud Facilities
power cooling
rack
space
IAM
Certificate
Management
Vulnerability
Scanning
Logging
Monitoring Auditing
Cloud Usage
Analysis
Resource
Manager
APIs
Cloud
Events
Notifications Cloud Guard
Tagging
Search

Publiek
Castle on the Cloud – Infrastructure as a Service
power cooling
rack
space
IAM
Certificate
Management
Vulnerability
Scanning
Logging
Monitoring Auditing
Cloud Usage
Analysis
Resource
Manager
APIs
Cloud
Events
Tagging
Search
• Servers (VMs and bare, dedicated and shared, small  huge)
• Storage (slow  fast, long short, object | block | ) & Encryption
• Network (internal, private, external/public; VPN; cloud interconnect)

Publiek
Castle on the Cloud – Platform as a Service
power cooling
rack
space
IAM
Certificate
Management
Vulnerability
Scanning
Logging
Monitoring Auditing
Cloud Usage
Analysis
Resource
Manager
APIs
Cloud
Events
Tagging
Search
SQL
Database Serverless
Functions
Container
engine
Data Science &
Big Data Engine
Vault
API
Gateway
Load
Balancer
Data
Catalog
Event
Broker
AI Services
Blockchain
BI &
Analytics
Data
Lake
Conversational
Services (chat)
Data
Integration
Low Code
Applications
Container
Registry
Artifact
Repository
Job
Scheduling
Build & Deploy
Pipelines
NoSQL
Database
Data
Cache
Code
Repository
Content
Management
Web Application
Firewall
CDN

Publiek
Castle on the Cloud – Software & Data as a Service
power cooling
rack
space
IAM
Certificate
Management
Vulnerability
Scanning
Logging
Monitoring Auditing
Cloud Usage
Analysis
Resource
Manager
APIs
Cloud
Events
Tagging
Search
SQL
Database
Serverless
Functions
Container
engine
Data Science &
Big Data Engine
Vault
API
Gateway
Load
Balancer
Data
Catalog
Event
Broker
Data
Lake
Data
Integration
Low Code
Applications
Container
Registry
Artifact
Repository
Job
Scheduling
Build & Deploy
Pipelines
NoSQL
Database
Data
Cache
Code
Repository
Web Application
Firewall
CDN
AI Services
Blockchain
BI &
Analytics
Conversational
Services (chat)
ERP, CRM,
SCM
Hospitality, Health, CPG, Discrete
Processing, Education, …
IoT Device Management & Predictive
Maintenance, Track & Trace, …
Self Service
Analytics
Company Risk
Analysis Data
DaaS for Sales
Content
Management

Publiek
Cloud Native Characteristics
• Easy com, easy go: Instant (ready to use) & Disposable
• Ephemeral
• the only real state: Infrastructure as Code, Configuration & Business Data
• Automated
• Elastic Scalability
• Pay for Used (or Configured/Reserved) Cloud Resources
• Managed (operated and maintained)
• Enterprise grade

Publiek
Cloud Native Custom Applications
• go all in with cloud vendor; leverage
managed facilities and platforms to the
max
• minimize time spent on non-functional
IT stuff
• accept the vendor lock in
All-in (SaaS > PaaS >>> IaaS)
• generic solutions that are vendor agnostic
and stay decoupled from specific cloud
platforms (as much as possible)
• run on any cloud and on premises
• typically using Kubernetes as platform
for container-based components and
applications
• using open (source) technologies and
products and associated staff & skills
• accept the higher management effort on
the platform components and more
technical work (by more IT savvy staff)
Cloud Vendor Independent (IaaS++)

Publiek
Use Case:
Selected Tweets to NoSQL, Streaming & Email
Streaming
NoSQL
Database
#hashtagofinterest

Publiek
Introducing Oracle Cloud Infrastructure

Publiek
Oracle Cloud
Infrastructure
• Generation 2 Cloud
• built on lessons learned
• Main themes:
• Competitive Pricing
• Secure by Design
• Open
• Enterprise (Technology)
• Trials – 30 days, $300 credits
• An always-free tier
• With Autonomous Database and
Autonomous Data Warehouse,
Compute, Storage,
• Many free tiers within paid services

Publiek
Gartner on OCI (September 2021)

Publiek
Oracle Cloud Infrastructure Regions – current and planned

Publiek
Demonstration of Cloud Native Application on OCI:
Tweets to NoSQL, Streaming & Email
Streaming
NoSQL
Database
#hashtagofinterest

Publiek
Cloud Native design
Tweets to NoSQL,
Streaming & Email
Healthcheck
Streaming
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Write JSON
document with
Tweets
Retrieve X
minutes worth
of tweets
Store JSON
file with all
tweets in time
period Trigger
function with
event
Create
Tweet
Records
in NoSQL
Send
Tweet
Report as
email
Invoke Tweet
Aggregator every
X minutes
Cloud Event
for new
JSON file
Publish
each
Tweet to
Stream
Expose
function to
external callers
Publish to
Notification
Topic
#hashtagofinterest
Get Twitter
credentials in
secure way
from vault
Custom code in multiple small
units that each build | test |
deploy | scale | fail
Asynchronous interactions
Managed Platform (and
underlying Infra) with built in
logging | monitoring | Ops
Configured through Infra as
Code
Auditing
Monitoring
Logging Container
Registry
Vault

Publiek
Decoupling
Streaming
Events
Object
Storage
Notification
Topic
API
Gate
way
NoSQL
Database
Function
Function
#hashtagofinterest
• Encapsulation (of
implementation)
• Run time availability
independence
• Independent release /
reconfigure
• Independence of scaling
• Volume Load
Throttling/Absorption
• Security Boundary
• Failure isolation
Auditing
Monitoring
Logging Container
Registry
Vault

Publiek
Platform Preparation – Infrastructure as Code
using Resource Manager & Terraform plan
Object
Storage
Object
Storage
Bucket
Compartments
Vault
Secure Vault
with Keys for
Twitter
credentials
Compartment for
Application resources
Configuration
of Logging
Service for
Functions
Virtual Cloud
Network
Internet
Gateway
Route Table
Security
Lists
Virtual Cloud Network
with private and public
subnet and access from
and to public internet
API
Gate
way
Skeleton API
Gateway for
deploying API
routing rules to
Groups
Dynamic
Groups for API
Gateway and
for Functions
Streaming
Stream for
publishing
messages to
NoSQL Databas
Table for
persisting record
Resource
Manager
Logging
Notification
Topic
Notification
Topic for new
Tweet Report
events
Auditing
Container
Registry
DevOps

Publiek
Building my castle on the cloud
• Create Tenancy (OCI Cloud Account) & Compartment
• setting up imaginary rackspace for virtual servers and storage
Compartments
Resource
Manager
Auditing
Logging
Telemetry/
Monitoring
Identity & Access
Management

Publiek
• VCN Wizard for virtual network
• create connections internally
Virtual Cloud
Network
Internet
Gateway
Route Table Security
Lists
Compartments
Resource
Manager
Auditing
Logging
Telemetry/
Monitoring
Identity & Access
Management

Publiek
• VCN Wizard for virtual network
• create connections internally
• Platform components (terraforming on the cloud
through Infrastructure as Code)
• instead of setting up servers, cables, OS images,
configuring networks, software installation & configuration
• Everything ephemeral – except the data, configuration and code
• At this point: no custom functionality yet
Object
Storage
Vault
Virtual Cloud
Network
Internet
Gateway
Route Table Security
Lists
Groups
Streaming
NoSQL
Container
Registry
Notification
Topic
Compartments
Resource
Manager
Auditing
Logging
Telemetry/
Monitoring
Identity & Access
Management
API
Gate
way

Publiek
The custom functionality for this use case?
• High coding in serverless functions
• read from Twitter, persist to file
• process tweets-file, publish to database and event stream
• API Gateway
• route to function TweetRetriever
• Cloud event rule
• push event to notification topic
• Notification subscription
• invoke function
• publish email
• And functional configuration
• twitter credentials
• email address to send notification to
• Using DevOps Build and Deploy Pipelines for automated rollout
Events
Function
Function
Object
Storage
Vault
Streaming
NoSQL
Notification
Topic
API
Gate
way
Container
Registry
DevOps

Publiek
Serverless Functions are the Workhorse of OCI
for non-long-running tasks

Publiek
Serverless Functions are the Worker Bees of OCI

Publiek
Serverless Functions on OCI
• OCI Serverless Functions are based on Fn
• Project Fn is an open source FaaS platform
that [in theory] you can run anywhere –
any cloud, on-premises or locally.
• A function handles an HTTP Request
• Functions are implemented with custom code
and packaged in [Docker] container images
• Out of the box support for many runtimes
•
• also support for custom Docker
Container (white box)

Publiek
Fn Functions – request handling
Function
Implementation
(Node, Java, Go,
Python, custom
Docker, …)
FDK
Function as a Service framework
HTTP Request
With method, headers, query
parameters, url path, body
input – derived from body
ctx – raw HTTP request components

Publiek
OCI Functions
• Stateless
• Load balanced
• Routed
• Authorization enforced
• Short running tasks
• Configuration parameters
• Rapid startup
• Pay per GB minute
Auditing
Monitoring
Logging
OCI Functions
Function
HTTP Request
OCI DevOps
API Gateway
HTTP Request
Application

Publiek
Mental Picture: Stateless and Serverless
FDK

Publiek
Mental Picture: Stateless and Serverless “execution engine”
FDK
Configuration
Parameters

Publiek
Mental Picture: Build Process
FDK
Container
Image
Registry
push
Operating
System
Language
Runtime
FDK
go1.15, java8, java, java11, node, node14, python, python3.6,
python, python3.7, python3.8, ruby, and kotlin

Publiek
Mental Picture: Build & Deploy Process
FDK
Container
Image
Registry
push
Operating
System
Language
Runtime
FDK
Oracle
Functions
on
OCI
Deploy Function Application
Associated with Network &
Compartment
Specify max time to run and
memory shape (128, 256,
512, 1024 MB) for function

Publiek
Mental Picture and Actual Runtime
Container
Image
Registry
Oracle
Functions
on
OCI
Container Orchestrator
VM
Server
128 | 256 | 512 | 1024 MB Memory,
32 | 64 | 128 | 256 MB File System
File system can be read, /tmp can be written to
Configuration Parameters available as
Environment Variables
Memory
Shape, Max
Time to Run,
Configuration
Parameters

Publiek
Container
Image
Registry
Oracle
Functions
on
OCI
VM
Server
Auditing
Monitoring
Logging
Container is kept running for 10-15 minutes – primed (hot) for handling
more requests.Then it is removed when it has been idle for that time.
It retains global state and file system contents during its lifetime. Note:
hold on to and reuse expensive connections.
Container handles one request at a time. Container can perform 10-13
seconds of background work after response was returned.

Publiek
Container
Image
Registry
Oracle
Functions
on
OCI
VM
Server
Auditing
Monitoring
Logging

Publiek
Container
Image
Registry
Oracle
Functions
on
OCI
VM A
Server 1
VM B
Server 2
Oracle Functions starts multiple Docker
containers, up to the limit specified for
your tenancy. The default limit is 30 GB
of RAM reserved for function execution
per availability domain
Auditing
Monitoring
Logging

Publiek
Pricing Oracle Functions – no use, no pay
(and even if quite a bit of use – then still no pay)

Publiek
Function execution is triggered by
API Gateway
Notifications
Events
Healthcheck
Resource
Manager
Service
Connector
Alarming
Functions
Streaming
OCI DevOps

Publiek
Function execution is triggered by
API Gateway
Notifications
Events
Healthcheck
Resource
Manager
Service
Connector
Alarming
Functions
Ops automation
Application
App
Ops
Ops
Ops
Ops
Ops
Ops
App
App
Alarming
Streaming
OCI DevOps
Ops

Publiek
Leverage OCI PaaS Services and Facilities from Functions
API Gateway
Notifications
Functions
Autonomous
Database
Streaming
Object
Storage
Vault
NoSQL
Database
Autonomous
JSON
Email Delivery
Auditing
Monitoring
Logging
synchronous
asynchronous

Publiek
Allow Functions to Invoke OCI APIs
through Resource Principal authorization
• Any OCI API call must be authenticated (signed) and authorized
• (Human) users can be granted permissions and can sign requests
• A function can be a resource principal – that is granted permissions (via
Dynamic Group) and gets an auto-generated key-file injected used for
signing
Function Object
Storage

Publiek
Allow Functions to Invoke OCI APIs
through Resource Principal authorization
• Any OCI API call must be authenticated (signed) and authorized
• (Human) users can be granted permissions and can sign requests
• A function can be a resource principal – that is granted permissions (via
Dynamic Group) and gets an auto-generated key-file injected used for
signing
Function Object
Storage
pem rpst
Dynamic
group
Policy
Rule
Resource

Publiek
Application as code
• Functions are NodeJS applications
• develop and test (run) as standalone applications
• Built from Code Repository as Fn Container Images
in OCI DevOps build pipeline
• pushed to Container Image Registry
• Deployed from Registry in OCI DevOps deployment pipeline
to Function Application on OCI
• Manually create secret in vault with Twitter credentials
• Pass secret’s identifier as function configuration
Container
Registry
Build Pipeline
Git Code
Repository

Publiek
Serverless Function
& Object Storage
Object
Storage
Function
Write JSON
document with
Tweets
Store JSON
file with all
tweets in time
period
#hashtagofinterest
Vault
Get Twitter
credentials in
secure way
from vault
Retrieve X
minutes worth
of tweets
Container
Image Registry
Central Logging
Service
Function
Tweet
Summarizer
Auditing
Logging
Container
Registry
Build Pipeline
Git Code
Repository

Publiek
Trigger
API
Gate
way
Function
#hashtagofinterest
Vault
Function
Tweet
Summarizer
Expose
function to
external callers
Object
Storage

Publiek
[how to] Trigger Email Notification
API
Gate
way
Function
#hashtagofinterest
Vault
Function
Tweet
Summarizer
Expose
function to
external callers
Send
Tweet
Report as
email
?
Object
Storage

Publiek
Produce CloudEvent &
Publish Notification
Events
Notifications
API
Gate
way
Function
Send
Tweet
Report as
email
Cloud Event
for new
JSON file
Publish to
Notification
Topic
#hashtagofinterest
Vault
Object
Storage

Publiek
EVENTS and NOTIFICATIONS SERVICES

Publiek
Web
Hook
Slack
Pager
Duty
Email
OCI
Resource
Cloud
Event
Notifi
catio
ns
Notification
Topic
Event
Rules
Functions
Streaming
Functi
ons
Strea
ming
Ev
ent Ev
ent
Ev
ent
Ev
ent
Events identified and turned to
Notification Events to be Published and Routed
Subscriptions
Cloud
Event
Alarming
Functions

Publiek
Configure Event Rule Notification triplet
OCI
Resource
Cloud
Event
Event
Rules
Notifi
catio
ns
Notification
Topic

Publiek
Send email upon Notification

Publiek
Email Subscription is Pending until confirmed

Publiek
When confirmed, the subscription is active

Publiek
When the Tweet Summarizer is invoked…
Events
Object
Storage
Notification
API
Gate
way
Function
Oracle Groundbreakers Tour 2020 LATAM | Oracle Cloud Native Application Development
Vault

Publiek
… the email informs of the new file
Events
Object
Storage
Notification
API
Gate
way
Function
Vault

Publiek
Trigger Function
Events
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Trigger
function with
event
#hashtagofinterest
Vault
Object
Storage

Publiek
Function: Create NoSQL Records
for all Tweets
Events
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Create
Tweet
Records
in NoSQL
#hashtagofinterest
Vault
Retrieve
Tweet
Report
Object
Storage

Publiek
Publish Tweet records to Stream
Streaming
Events
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Publish
each
Tweet to
Stream
#hashtagofinterest
Vault
Object
Storage

Publiek
Summary
Healthcheck
Streaming
Events
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
#hashtagofinterest
Auditing
Monitoring
Logging Container
Registry
Vault
DDoS
Protection
WAF
Cloud Guard
Identity & Access
Management
Cloud Native:
Pay per use/TCO
Object
Storage
DevOps

Publiek
Pay per use
Healthcheck
Streaming
Events
Object Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
Auditing
Monitoring
Logging Container Registry
Vault
Cloud Guard
Identity & Access
Management

Publiek
Summary
Healthcheck
Streaming
Events
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
#hashtagofinterest
Monitoring
Vault
DDoS
Protection
WAF
Cloud Guard
Identity & Access
Management
Cloud Native:
Pay per use/TCO
Object
Storage
Auditing
Container
Registry
DevOps

Publiek
Summary
Healthcheck
Streaming
Events
Object
Storage
Notifications
API
Gate
way
NoSQL
Database
Function
Function
Compartments
Email Delivery
#groundbreakerstour
Monitoring
Vault
DDoS
Protection
WAF
Cloud Guard
Identity & Access
Management
Cloud Native:
Platform Services
Managed => Serverless
Quick Provision & Decommission
Distributed
Automated
Pay per use/TCO
Vendor takes runtime responsibility
Enterprise grade platform for all
Security & Availability
Scale
Ops facilities (monitor, log, audit,
events, failover)
Rapid Innovation (new services, new
features, new pricing)
Auditing
Container
Registry
DevOps

Thank you
for your attention
I hope
this was
useful
lucas.jellema@amis.nl | technology.amis.nl | @lucasjellema | lucas-jellema
Sources and slides:
bit.ly/cloud-native-ogb-apacouc2021

Cloud Native Application Development - build fast, low TCO, scalable & agile software on Oracle Cloud (APAC Oracle Groundbreaker Tour 2021, november 2021)

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Cloud Native Application Development - build fast, low TCO, scalable & agile software on Oracle Cloud (APAC Oracle Groundbreaker Tour 2021, november 2021)

Similar to Cloud Native Application Development - build fast, low TCO, scalable & agile software on Oracle Cloud (APAC Oracle Groundbreaker Tour 2021, november 2021) (20)

More from Lucas Jellema

More from Lucas Jellema (20)

Recently uploaded

Recently uploaded (20)

Cloud Native Application Development - build fast, low TCO, scalable & agile software on Oracle Cloud (APAC Oracle Groundbreaker Tour 2021, november 2021)

Editor's Notes