Discusses implications of Serverless technology and what needs to be done to realize its full potential.

1. © BST LABS 2020 ALL RIGHTS RESERVED
If your computer is
cloud
What its Operating System should
look like?
Asher Sterkin
General Manager
Follow up discussion of the Medium article:

2. 2© BST LABS 2020 ALL RIGHTS RESERVED
About Myself
● Software Technologist (40 years in the field)
● SVP Engineering at Black Swan Technologies
● General Manager of BST LABS
● Acting Chief Programmer of the CAIOS project
● Former Distinguished Engineer at Cisco Engineering OCTO
● Former VP Technologies at NDS (acquired by Cisco in 2012)
● Contacts:
○ Medium
○ Slideshare
○ Linkedin
○ Twitter
○ E-mail

3. 3© BST LABS 2020 ALL RIGHTS RESERVED
Major Article Claims
● Serverless it’s a truly disruptive technology
● Existing mainstream tools are inadequate for serverless
● To utilize its full potential a radical rethinking is required:
○ What is Computer?
○ What is Programming?
○ What is an Operating System?
○ What is Middleware?
○ What is Application?
○ What is Testing?
○ What is Source Code Management?
○ What is Productivity?
○ What is Quality?
This talk

4. 4© BST LABS 2020 ALL RIGHTS RESERVED
Disruptive Technology...
Overshoot regular user needs at
expense of convenience. Most of the
time, Big Data is not that big.

5. 5© BST LABS 2020 ALL RIGHTS RESERVED
Radical Rethinking ...
Daniel Kim, “The 3rd
Generation Leadership Challenge”,
Keynote at Systems Thinking in Action 2010
Serverless disruption
“Gentlemen, the telephone system of the
United States was destroyed last night.”

6. 6© BST LABS 2020 ALL RIGHTS RESERVED
What is Cloud
Computer?

7. 7© BST LABS 2020 ALL RIGHTS RESERVED
One region of one account of one vendor
Region (host) Region (host)
Managed AI Services Managed AI Services
CF Stack
(resource group)
App Repository
Code Repository
API
API

8. 8© BST LABS 2020 ALL RIGHTS RESERVED
Control
Unit
ALU
Mid-speed Block K/V or Heap Memory
Slow Bulk K/V or Heap Memory
Mid-speed Tabular Memory
Slow Tabular Memory
External
Interfacing
(ports)
High Throughput Bus (Push)
High Throughput Bus (Pull)
Low-latency Pub/Sub
Direct Connection Async Pipe
Component
Repository
Component
Configuration
Telemetry
Hierarchical Memory
Access
Control
Encryption
MLU
DFU
Cloud AI Computer “Hardware” Specification
Immutable Ledger Memory
zero trust
replication

9. 9© BST LABS 2020 ALL RIGHTS RESERVED
What Cloud
Computer
Programming is?

10. 10© BST LABS 2020 ALL RIGHTS RESERVED
Domain-Specific “Virtual” Machine
Development
Down/Top
Bottom/Up
What we have (“hardware”)
Intermediate translation (“in terms of”)
What we need (“application”)
Media Plane
Control Plane
MediaPlane
ControlPlane

11. 11© BST LABS 2020 ALL RIGHTS RESERVED
MediaPlaneControlPlane
Internet
Ports
step_1
if
step_N
Control Flow
Data Flow
(a + b)/c
(a or b) and c
Memory
Memory
AI Services
Control vs Data Plane
load/store
load/store
compute
handle
Logic
Logic
(a + b)/c
(a or b) and c

12. 12© BST LABS 2020 ALL RIGHTS RESERVED
What Cloud
Operating System is?

13. 13© BST LABS 2020 ALL RIGHTS RESERVED
<<layer>>
Application
<<layer>>
Framework
<<layer>>
Middleware
<<layer>>
Operating System
<<layer>>
Drivers
● Optimal Resource Utilization of one Computer
● Hardware Abstraction
● Security
● Productivity
● Scaling Up
● Inter-process Communication
● Optimal Resource Utilization of Distributed System
● Data Replication
● Scaling Out
● High-availability
● Optimal distribution
● Standard Library
● Cloud Flow Programming Compiler
● Cloud Vendor SDK & Development Tools
Optimal Resource Utilization

14. 14© BST LABS 2020 ALL RIGHTS RESERVED
Operational Statistics
Coroutine (Fiber, Green Thread)
POSIX Thread
OS Process
Container
State Machine
Flow Stage Specification
Basic Primitives:
● Standard Library
● Custom Extensions
Intermediate
Representation
Platform-Specific
Representation
Translation
Code
Generation and
Optimization
Optimization Models
Machine Learning
Concurrency Structure Optimization
Optimization Target: minimal
cost
Constraints:
● latency SLA
● IP protection

15. 15© BST LABS 2020 ALL RIGHTS RESERVED
Computation Unit Structure Optimization
Secure
Package
Repository
Certified 3rd party
and in-house
developed
caios-py-import Computation Unit
Initial Configuration:
development/unit
testing
Operational Statistics
Optimization Models
Machine Learning
Secure
Package
Repository
Certified 3rd party
and in-house
developed
caios-py-import Computation Unit
Optimal Packaging
Structure
shared
private
Optimization Target: minimal
cost
Constraints:
● latency SLA
● IP protection

16. 16© BST LABS 2020 ALL RIGHTS RESERVED
Cloud AI Operating System (CAIOS) leapfrogs software development
languages and tools for the next generation of cloud
Cloud AI Operating System (CAIOS)

17. © BST LABS 2020 ALL RIGHTS RESERVED
Questions?