Not so FaaS, Streaming ML with Kafka! (Praveen Hirsave, VRBO) Kafka...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

©2019 Vrbo. All rights reserved.1
Not so FaaS, Streaming ML with Kafka!
Praveen Hirsave, Senior Director Cloud Platform
Ma...

Part of the Austin community since 2005
2 MILLION+ 190
Unique places to stay Countries Part of the Expedia Group
family

©2019 Vrbo. All rights reserved.3
Praveen Hirsave
Senior Director, Cloud Platform
Blog: https://medium.com/homeaway-tech-b...

1. The promise of FaaS
2. The Reality of FaaS
3. Our Multicloud Journey
4. Multi Tier Streaming
5. Multi FaaS Workloads

©2019 Vrbo. All rights reserved.
Events are everywhere! So show me the $$$
5
ML
f(Stream)+/-
$$$

©2019 Vrbo. All rights reserved.6
What is Serverless?
A programming abstraction that enables
users to upload programs, run...

©2019 Vrbo. All rights reserved.7
What is FaaS?
The Function as a Service (FaaS), layer runs
polyglot user code in the for...

©2019 Vrbo. All rights reserved.8
Why FaaS?
Hypothesis: utilizing FaaS architecture
enables less code, faster development,...

©2019 Vrbo. All rights reserved.9
Cloud Offerings
1
Using FaaS solutions provided by cloud
vendors provides limited capabi...

©2019 Vrbo. All rights reserved.10
Alternative Offerings
Using CDNs and/or open source FaaS
solutions provide limited inte...

©2019 Vrbo. All rights reserved.11
Limitations of FaaS
Love to faults is always blind!
1 Limited execution lifetimes
2 No ...

©2019 Vrbo. All rights reserved.12
What is FaaS good at?
Using CDNs and/or open source FaaS
solutions provide limited inte...

©2019 Vrbo. All rights reserved.
HomeAway Journey - Our Guiding Principles
13
Multicloud Tech Agnostic SRECost Visible
Blo...

©2019 Vrbo. All rights reserved.
12 Factor Applications
Cost Transparency
Location Services
Observability
Governance
Cloud...

©2019 Vrbo. All rights reserved.
Mind your 12-Factors! Ministry of Truth
15
Standardized Multicloud Chassis
MPaaS
MoT
CPU:...

©2019 Vrbo. All rights reserved.
Mind your Streams! Stream Registry
Blog: The need for a Stream Registry
Command Events
Do...

Run real time collection and classification
functionality at the edge.
1 Event Driven Edge
2 Run close to the customer
3
R...

FaaS is dead. Long live MFaaS.
1
Vendor agnostic serverless with
zero infrastructure code
2
Integrations with existing
inf...

In MFaaS we trust!
1 Polyglot & Composable
2
Zero Build, Adapters, Reactive
Scheduler
3
Multiplatform, Persistence support...

Quick code demo ping, java app, kafka
Demo 1 (optional)
Hello Python Function
Credits: Andrew Kreiling – Cloud Platform Ar...

Quick code demo ping, java app, kafka
Demo 1 (optional)
Kafka Adapter
Credits: Andrew Kreiling – Cloud Platform Architect

FaaS Workloads
Traditional FaaS workloads are triggered by
various events such as HTTP, queues and
streams.
1 Asynchronous...

Streams on FaaS
Removing all run time constraints FaaS
enables SPaaS!
1
Can be processed as ordered or
unordered
2 Indefin...

Streams on FaaS
Removing all run time constraints FaaS
enables SPaaS!
1
Can be processed as ordered or
unordered
2 Indefin...

Batch on FaaS
By relaxing run time constraints and
providing a persistence layer, we enable
batch processing with FaaS.
1
...

By relaxing run time constraints and
providing a persistence layer, we enable
batch processing with FaaS.
1
Can be process...

GraphQL FaaS
Distributed data and rendering
1 Simplified Architecture
2 Run close to the customer
3 Globally distributed r...

Streams and ML
1 Data lineage with stream registry
2
Provide a backplane for a feature
registry
3
Supports off-line and on...

ML on MFaaS
Batch or Streams on FaaS allow us to construct a platform to train models as well as run
predictions.

Parallelization of Model Training
FaaS coupled with newer libraries like numpywren allows us to distribute the training of...

Parallelization of Hyperparameter Tuning
FaaS allows us to launch multiple model training sessions in parallel. After trai...

©2019 Vrbo. All rights reserved.32
ML in KSQL
Exploiting KSQL stream transformation and
user-defined functions to deploy r...

Quick code demo ML in KSQL UDF
Credits: Chris Harris – Cloud Platform Architect
Demo 2 (optional)

Next Steps!
1
This is only a small start, there are
hard problems to solve
2 Contribute to this OSS journey
3 Checkout the...

© 2018 HomeAway. All rights reserved
THANK YOU!

© 2018 HomeAway. All rights reserved
26
Locations worldwide
We are hiring!
Check out our job openings at
https://lifeatexp...

©2019 Vrbo. All rights reserved.
Q&A
37

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1059379 views
Storytelling For The Web: Integrate... by Chiara Aliotta 976667 views
Artificial Intelligence, Data and C... by OECD Directorate ... 914599 views
How to Leverage AI to Boost Employe... by SocialHRCamp 387831 views
2024 State of Marketing Report – by... by Marius Sescu 219508 views
Everything You Need To Know About C... by Expeed Software 236350 views

View on Slideshare

1 of 37 Ad

View on Slideshare

1 of 37 Ad