When Connections are Magic: Understanding Performance in Serverless

•

0 likes•10 views

Observability! Cloud Functions! APIs! What could go wrong?! While researching the performance of object storage APIs there appeared to be custom run time magic happening, leading to significant performance differences. Further research showed that it was *not magic*, but lead to even more questions. Working with modern systems means network connections, many of them. Understanding how those connections impact your customer's experience can be difficult. Distributed tracing helps isolate what parts of the system are failing, but when only implemented at the RPC level the reasons for and scope of network induced issues can be lost. See how network level insights can be integrated into distributed traces and hear how to effectively practice iterative observability from the specific case of this research to a general framework for investigation.

Technology

How can I see what’s really
happening (and why)?

Function API Storage
SYN
SYN/ACK
ACK
ClientHello
ServerHello
ClientKeyExchange…
ChangeCipher…
HTTP Request
HTTP Response
Storage RPC Req
Storage RPC Response

Function API Storage
TCP (1 RT)
TLS (2 RT)
HTTP (1 RT)

Further Research is Needed
TLS Latency
GCS OAuth

Further Research is Needed
TLS Latency
GCS OAuth
DNS Latency

Further Research is Needed
TLS Latency
GCS OAuth
DNS Latency
Multimodal Fetches

Latency
• From what locations?
• At what request rate?
• With what variance?

Throughput
• With what parallelism?
• With what sizes?
• With what variance?

Region
Availability Zone
Instance
Pod
Networking Group
Security Group
Customer ID
Version / Hash
Conﬁg Version / Hash
Remote Region
Remote Availability Zone
Remote DNS
Remote IP

Thank You!
And Try LightStep Sandbox at https://lightstep.com/play

It’s impossible to understand the health of your system without real-time logging. Our logging platform is one of our favorite and most popular features, and currently handles millions of requests and gigabytes per second of traffic. It’s stateless, real-time, and can provide insight and ship data to a multitude of destinations. Fastly has consistently iterated to keep up with the growth of the platform, and we’ve learned many lessons along the way. In this talk, you’ll get a peek into the system, and how we’ve developed it.

Microservices on .NET

Vitaly Baum

How Hootsuite Manages Its Growing Microservice Landscape

Adam Arsenault

APIdays Helsinki 2019 - gRPC: Lightning Fast, Self-Documenting APIs with Moha...

apidays

Microservices:  The phantom menace . Istio Service Mesh:  the new hope

Sergii Bishyr

Building Microservices with gRPC and NATS

Shiju Varghese

OpenTelemetry is one of the newest projects in the realm of Observability at the CNCF and is already the second most active project there. In this session, Juraci Paixão Kröhling will talk about the different subprojects and how to get started using them. Even if you heard about OpenTelemetry before, you'll leave this session with a better understanding of what this is all about, the several faces of OpenTelemetry, and what you can do to make your projects more observable.

Inter-Process Communication in Microservices using gRPC

Shiju Varghese

Kuberntes Ingress with Kong

Nebulaworks

Kubernetes ecosystem is seeing adoption across the industry and is on the path to becoming the de-facto orchestration platform on modern cloud service delivery. Kubernetes not only provides primitives for deploying run microservices in the cloud but goes one step further and helps you define interactions and lifecycle for your APIs. The Ingress API in Kubernetes allows you to expose your microservice to the outside world and define routing policies for your north-south traffic (or traffic coming into your virtual data center). We invite Harry Bagdi, Sr. Cloud to discuss in-depth about the design and why of Ingress resource, the benefits of using Ingress to manage your API lifecycle using CI/CD pipelines, and how you can accomplish Ingress using a popular open-source solution, Kong. Kong’s Ingress Controller implements authentication, load-balancing, traffic throttling, transformations, caching, metrics, and logging across Kubernetes clusters.

Istio Service Mesh

Luke Marsden

Building Language Agnostic APIs with gRPC - JavaDay Istanbul 2017

Mustafa AKIN

Managing Kubernetes from Python using Kube

David Charles

My graduation project on Opsschool ('the elephant')

Liora Kamil

Building High Performance APIs In Go Using gRPC And Protocol Buffers

Shiju Varghese

Axon Server went RAFTing

J On The Beach

RAFT protocol is a well-known protocol for consensus in Distributed Systems. Want to learn how consensus is achieved in a system with a large amount of data such as Axon Server’s Event Store? Join this talk to hear about all specifics regarding data replication in highly available Event Store! Axon is a free and open source Java framework for writing Java applications following DDD, event sourcing, and CQRS principles. While especially useful in a microservices context, Axon provides great value in building structured monoliths that can be broken down into microservices when needed. Axon Server is a messaging platform specifically built to support distributed Axon applications. One of its key benefits is storing events published by Axon applications. In not so rare cases, the number of these events is over millions, even billions. Availability of Axon Server plays a significant role in the product portfolio. To keep event replication reliable we chose RAFT protocol for consensus implementation of our clustering features. In short, consensus involves multiple servers agreeing on values. Once they reach a decision on a value, that decision is final. Typical consensus algorithms make progress when any majority of their servers is available; for example, a cluster of 5 servers can continue to operate even if 2 servers fail. If more servers fail, they stop making progress (but will never return an incorrect result). Join this talk to learn why we chose RAFT; what were our findings during the design, the implementation, and testing phase; and what does it mean to replicate an event store holding billions of events!

Ten Years of Failing Microservices

Phil Calçado

2021 JCConf 使用Dapr簡化Java微服務應用開發

Rich Lee

How we use Python at Bitbucket

Mark Adams

Infinum Android Talks #05 - Square tape

Infinum

Running Flink in Production: The good, The bad and The in Between - Lakshmi ...

Flink Forward

The streaming platform team at Lyft has been running Flink jobs in production for more than a year now, powering critical use cases like improving pickup ETA accuracy, dynamic pricing, generating machine learning features for fraud detection, real-time analytics among many others. Broadly, the jobs fall into two abstraction layers: applications (Flink jobs that run on the native platform) and analytics (that leverage Dryft, Lyft’s fully managed data processing engine). This talk will give an overview of the platform architecture, deployment model and user experience. The talk will also dive deeper into some of the challenges and the lessons that were learnt, running Flink jobs at scale, specifically around scaling Flink connectors, dealing with event time skew (source synchronization) and highlight common patterns of problems observed across several Flink jobs. Finally, the talk will give insights into how we are re-architecting the streaming platform @ Lyft using a Kubernetes based deployment.

Spring Cloud Star

Spencer Gibb

Apache Flink Community Updates November 2016 @ Berlin Meetup

Robert Metzger

2019 05-28 SRE Consul Criteo Meetup

Pierre Souchay

This presentation explains the challenges we face at Criteo on discovering machines and services. Criteo is using HashiCorp's Consul to discover services. We explain what is Consul, how it works, what are the challenges we faced and how we improved it. We also explain how using it in combinaison with consul-templaterb can allow us performing Inversion Of Control for the whole infrastructure allowing us to use it as a database and iterating faster.

Custom Mongrel Handlers: Learning how to walk the dog

Ezra Zygmuntowicz

Introduction to Blockchain Tests Workshop at The National Software Testing C...Rafaela Azevedo

Bringing Elliptic Curve Cryptography into the Mainstream

Nick Sullivan

In this talk I will describe how CloudFlare helped take elliptic curve cryptography from a promising technology with low adoption to core part of the HTTPS revolution. Two years ago, almost every public key used on the web for HTTPS was an RSA key. In 2013, the zmap team from University of Michigan scanned the entire web and found fewer than twenty non-RSA certificates. Over the next two years, CloudFlare took that number into the millions with the Universal SSL project. We’ll describe how using ECDSA (Elliptic Curve Digital Signature Algorithm) keys instead of RSA keys played a crucial role in enabling this project. With Universal SSL, any website can become HTTPS-enabled for free. Elliptic curve cryptography is not just useful for HTTPS, there are other protocols for which it provides an advantage over RSA. One of these is DNSSEC, the algorithm that lets administrators digitally sign DNS records for authenticity. DNSSEC been described as difficult deploy and dangerous because of the potential to abuse it in amplification/reflection attacks. In October 2015, CloudFlare launched its automated DNSSEC beta program. We’ll describe some of the tweaks we made to easily scale DNSSEC to millions of zones and how ECDSA keys helped solve some of the protocol’s major issues.

apidays LIVE India - Asynchronous and Broadcasting APIs using Kafka by Rohit ...

apidays

Gluecon - Kafka and the service mesh

Gwen (Chen) Shapira

What's hot

Juraci Paixão Kröhling - All you need to know about OpenTelemetry

Juliano Costa

Inter-Process Communication in Microservices using gRPC

Shiju Varghese

Kuberntes Ingress with Kong

Nebulaworks

Istio Service Mesh

Luke Marsden

Building Language Agnostic APIs with gRPC - JavaDay Istanbul 2017

Mustafa AKIN

Managing Kubernetes from Python using Kube

David Charles

My graduation project on Opsschool ('the elephant')

Liora Kamil

Building High Performance APIs In Go Using gRPC And Protocol Buffers

Shiju Varghese

Axon Server went RAFTing

J On The Beach

Ten Years of Failing Microservices

Phil Calçado

2021 JCConf 使用Dapr簡化Java微服務應用開發

Rich Lee

How we use Python at Bitbucket

Mark Adams

Infinum Android Talks #05 - Square tape

Infinum

Running Flink in Production: The good, The bad and The in Between - Lakshmi ...

Flink Forward

Spring Cloud Star

Spencer Gibb

Apache Flink Community Updates November 2016 @ Berlin Meetup

Robert Metzger

2019 05-28 SRE Consul Criteo Meetup

Pierre Souchay

Custom Mongrel Handlers: Learning how to walk the dog

Ezra Zygmuntowicz

Introduction to Blockchain Tests Workshop at The National Software Testing C...Rafaela Azevedo

Bringing Elliptic Curve Cryptography into the Mainstream

Nick Sullivan

What's hot (20)

Juraci Paixão Kröhling - All you need to know about OpenTelemetry

Inter-Process Communication in Microservices using gRPC

Kuberntes Ingress with Kong

Istio Service Mesh

Building Language Agnostic APIs with gRPC - JavaDay Istanbul 2017

Managing Kubernetes from Python using Kube

My graduation project on Opsschool ('the elephant')

Building High Performance APIs In Go Using gRPC And Protocol Buffers

Axon Server went RAFTing

Ten Years of Failing Microservices

2021 JCConf 使用Dapr簡化Java微服務應用開發

How we use Python at Bitbucket

Infinum Android Talks #05 - Square tape

Running Flink in Production: The good, The bad and The in Between - Lakshmi ...

Spring Cloud Star

Apache Flink Community Updates November 2016 @ Berlin Meetup

2019 05-28 SRE Consul Criteo Meetup

Custom Mongrel Handlers: Learning how to walk the dog

Introduction to Blockchain Tests Workshop at The National Software Testing C...

Bringing Elliptic Curve Cryptography into the Mainstream

Similar to When Connections are Magic: Understanding Performance in Serverless

apidays LIVE India - Asynchronous and Broadcasting APIs using Kafka by Rohit ...

apidays

Gluecon - Kafka and the service mesh

Gwen (Chen) Shapira

Understanding the Web through HTTP

Olivia Brundage

Nss Labs Dpi Intro V3

gueste47133

Stephan Ewen - Experiences running Flink at Very Large Scale

Ververica

This talk shares experiences from deploying and tuning Flink steam processing applications for very large scale. We share lessons learned from users, contributors, and our own experiments about running demanding streaming jobs at scale. The talk will explain what aspects currently render a job as particularly demanding, show how to configure and tune a large scale Flink job, and outline what the Flink community is working on to make the out-of-the-box for experience as smooth as possible. We will, for example, dive into - analyzing and tuning checkpointing - selecting and configuring state backends - understanding common bottlenecks - understanding and configuring network parameters

The Good, the Bad and the Ugly of Migrating Hundreds of Legacy Applications ...

Josef Adersberger

Running applications on Kubernetes can provide a lot of benefits: more dev speed, lower ops costs, and a higher elasticity & resiliency in production. Kubernetes is the place to be for cloud native apps. But what to do if you’ve no shiny new cloud native apps but a whole bunch of JEE legacy systems? No chance to leverage the advantages of Kubernetes? Yes you can! We’re facing the challenge of migrating hundreds of JEE legacy applications of a major German insurance company onto a Kubernetes cluster within one year. We're now close to the finish line and it worked pretty well so far. The talk will be about the lessons we've learned - the best practices and pitfalls we've discovered along our way. We'll provide our answers to life, the universe and a cloud native journey like: - What technical constraints of Kubernetes can be obstacles for applications and how to tackle these? - How to architect a landscape of hundreds of containerized applications with their surrounding infrastructure like DBs MQs and IAM and heavy requirements on security? - How to industrialize and govern the migration process? - How to leverage the possibilities of a cloud native platform like Kubernetes without challenging the tight timeline?

Migrating Hundreds of Legacy Applications to Kubernetes - The Good, the Bad, ...

QAware GmbH

CloudNativeCon North America 2017, Austin (Texas, USA): Talk by Josef Adersberger (@adersberger, CTO at QAware) Abstract: Running applications on Kubernetes can provide a lot of benefits: more dev speed, lower ops costs, and a higher elasticity & resiliency in production. Kubernetes is the place to be for cloud native apps. But what to do if you’ve no shiny new cloud native apps but a whole bunch of JEE legacy systems? No chance to leverage the advantages of Kubernetes? Yes you can! We’re facing the challenge of migrating hundreds of JEE legacy applications of a major German insurance company onto a Kubernetes cluster within one year. We're now close to the finish line and it worked pretty well so far. The talk will be about the lessons we've learned - the best practices and pitfalls we've discovered along our way. We'll provide our answers to life, the universe and a cloud native journey like: - What technical constraints of Kubernetes can be obstacles for applications and how to tackle these? - How to architect a landscape of hundreds of containerized applications with their surrounding infrastructure like DBs MQs and IAM and heavy requirements on security? - How to industrialize and govern the migration process? - How to leverage the possibilities of a cloud native platform like Kubernetes without challenging the tight timeline?

Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)

Spark Summit

Big datadc skyfall_preso_v2

abramsm

Interledger Protocol Stack Deep Dive @ Boston Interledger Meetup

Interledger

Thaker q3 2008Obsidian Software

Bringing Learnings from Googley Microservices with gRPC - Varun Talwar, Google

Ambassador Labs

What is a Service Mesh and what can it do for your Microservices

Matt Turner

e’ll explore what a service mesh is and what it can do for your microservices. Are the claims of observability, resiliency, and WAF features real? Are they useful during development, production, or both? Using pictures and demos, we’ll find out! This session will also briefly cover how a service mesh works, giving us a mental model with which to explore and evaluate after the talk. Matt will show a simple installation and demo, giving us all the knowledge to go home and try for ourself.

apidays Australia 2023 - The Playful Bond Between REST And Data Streams, Warr...

apidays

apidays Australia 2023 - Platforms, Products, and People: The Power of APIs October 11 & 12, 2023 https://www.apidays.global/australia/ The Playful Bond Between REST And Data Streams Warren Vella, Solutions Engineer at Confluent ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

The Playful Bond Between REST And Data Streams

confluent

Insider Threat Visualization - HITB 2007, Kuala Lumpur

Raffael Marty

Netflix Play API: Why we built an evolutionary architecture

Suudhan Rangarajan

E Snet Authentication Fabric Pilot

FNian

You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard

confluent

(Stephen Parente + Jeff Field, Blizzard) Kafka Summit SF 2018 Blizzard’s global data platform has become a driving force in both business and operational analytics. As more internal customers onboard with the system, there is increasing demand for custom applications to access this data in near real time. In order to avoid many independent teams with varying levels of Kafka expertise all accessing the firehose from our critical production Kafkas, we developed our own pub-sub system on top of Kafka to provide specific datasets to customers on their own cloud deployed Kafka clusters.

Apache Flink(tm) - A Next-Generation Stream Processor

Aljoscha Krettek

In diesem Vortrag wird es zunächst einen kurzen Überblick über den aktuellen Stand im Bereich der Streaming-Datenanalyse geben. Danach wird es mit einer kleinen Einführung in das Apache-Flink-System zur Echtzeit-Datenanalyse weitergehen, bevor wir tiefer in einige der interessanten Eigenschaften eintauchen werden, die Flink von den anderen Spielern in diesem Bereich unterscheidet. Dazu werden wir beispielhafte Anwendungsfälle betrachten, die entweder direkt von Nutzern stammen oder auf unserer Erfahrung mit Nutzern basieren. Spezielle Eigenschaften, die wir betrachten werden, sind beispielsweise die Unterstützung für die Zerlegung von Events in einzelnen Sessions basierend auf der Zeit, zu der ein Ereignis passierte (event-time), Bestimmung von Zeitpunkten zum jeweiligen Speichern des Zustands eines Streaming-Programms für spätere Neustarts, die effiziente Abwicklung bei sehr großen zustandsorientierten Streaming-Berechnungen und die Zugänglichkeit des Zustandes von außerhalb.

Similar to When Connections are Magic: Understanding Performance in Serverless (20)

apidays LIVE India - Asynchronous and Broadcasting APIs using Kafka by Rohit ...

Gluecon - Kafka and the service mesh

Understanding the Web through HTTP

Nss Labs Dpi Intro V3

Stephan Ewen - Experiences running Flink at Very Large Scale

The Good, the Bad and the Ugly of Migrating Hundreds of Legacy Applications ...

Migrating Hundreds of Legacy Applications to Kubernetes - The Good, the Bad, ...

Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)

Big datadc skyfall_preso_v2

Interledger Protocol Stack Deep Dive @ Boston Interledger Meetup

Thaker q3 2008

Bringing Learnings from Googley Microservices with gRPC - Varun Talwar, Google

What is a Service Mesh and what can it do for your Microservices

apidays Australia 2023 - The Playful Bond Between REST And Data Streams, Warr...

The Playful Bond Between REST And Data Streams

Insider Threat Visualization - HITB 2007, Kuala Lumpur

Netflix Play API: Why we built an evolutionary architecture

E Snet Authentication Fabric Pilot

You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard

Apache Flink(tm) - A Next-Generation Stream Processor

More from DevOps.com

Modernizing on IBM Z Made Easier With Open Source Software

When Connections are Magic: Understanding Performance in Serverless

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to When Connections are Magic: Understanding Performance in Serverless

Similar to When Connections are Magic: Understanding Performance in Serverless (20)

More from DevOps.com

More from DevOps.com (20)

Recently uploaded

Recently uploaded (20)

When Connections are Magic: Understanding Performance in Serverless