Current FaaS (function as a service) solutions are used for ETL, offline and batch jobs, but rarely for heavy-lifting core business apps in production. In this presentation, I will argue that the invocation latency is the main reason for the slow adoption of FaaS in real-time applications, and offer some useful tools to reduce that latency in current and future platforms.

2. Welcome!

3. Thank You!
Royi Benyossef, Samsung Next
Shaked Zak-Goldstein, Samsung Next
Evgeny Zislis, Devops Israel
Daniela Kortin Shterenzon, Devops Israel
Mickey Shulman, Binaris

4. How
to
Make
It
Fa(a)ster?

6. Are you
using
FaaS
in
production?

7. Are you
using
FaaS
for your
core
business
apps in
production?

8. Why?

9. Because it is slow

10. ⨍
⨍
⨍
⨍
⨍
⨍
⨍
⨍⨍
⨍ ⨍
Composition
Architecture

11. ⨍
⨍
⨍
⨍
⨍
⨍
⨍
⨍⨍
⨍ ⨍
Composition
Architecture
Class
Module
Package
Library
App
Service

12. Long call chains
Fast function calls

13. How do we measure speed?
Can we improve FaaS
performance?

14. Network
Latency
How do we measure speed?
Invocation
Latency
Execution
time

15. Network
Latency

16. Region
Network
Latency
3-35ms
4G: +50ms
5G: +1ms

17. 2ms
Region
AZ
DC DC
½ms
AZ
DC DC
½ms

18. Network
Latency
How do we measure speed?
Invocation
Latency
½ms - 40ms
Execution
time

19. Invocation
Latency

20. Region
Empty λ
Initiator λ
Empty λ
Empty λ
Empty λ

21. Cold Start Warm Start

22. Invocation
Latency
30-150ms

23. Network
Latency
How do we measure speed?
Invocation
Latency
½ms - 40ms 30ms - 150ms
Execution
time

24. Network
Latency
How do we measure speed?
Invocation
Latency
1/4 ms - 40 ms 30ms-150ms
Execution
time

25. What can we do?

26. ① Programming language

27. 0 ms
20 ms
40 ms
60 ms
80 ms
100 ms
6h 12h 18h 24h0
JavaScript
Python
Java

28. ② Invocation method

29. 0 ms
50 ms
100 ms
150 ms
200 ms
99% AWS-SDK
99% API GATEWAY
6h 12h 18h 24h0

30. ③ Memory

31. 0 ms
20 ms
40 ms
60 ms
80 ms
100 ms
6h 12h 18h 24h0
128MB
256MB
512MB
1024MB

32. ④ Load

33. 0.0 s
0.5 s
1.0 s
1.5 s
2.0 s
2.5 s
3.0 s
0 200 400 600 800
Concurrency

34. ⑤ Network

35. ⑥ Cloud Provider

36. 1 ms
10 ms
100 ms
1000 ms
6h 12h 18h 24h0
AWSGoogle BluemixAzure Binaris
9.3
15.9
0.2
5.0
9.6

37. ⑦ Fewer calls

38. ⨍
⨍
⨍
⨍
⨍
⨍
⨍
⨍⨍
⨍ ⨍

39. ⨍⨍
⨍f
f
f
ff
f
f
f
f

40. ⨍⨍
⨍f
f
f
ff
f
f
f
f
Well…

42. Summary
Latency Matters in FaaS
Current Latency is 30-150ms
There are easy ways to reduce it!

43. Summary
① Programming language
③ Memory
⑦ Fewer calls
② Invocation method
④ Load
⑤ Network
⑥ Cloud Provider

44. www.faasmark.com
www.binaris.com

45. Questions?

46. Thank You