Serverless Architecture at iRobot

•Download as PPTX, PDF•

1 like•1,317 views

This document discusses iRobot's adoption of serverless architecture and the reasons for choosing it. Some key benefits identified are lower latency and cost compared to monolithic or microservices architectures. Specific challenges addressed by serverless include deployment, service discovery, and security. While serverless addresses many issues, the document notes there is still room for improvement from cloud providers in areas like deployment models and integration testing.

Engineering

Serverless Architecture at iRobot
Ben Kehoe, Cloud Robotics Research Scientist
@ben11kehoe
2016-10-27

How and why did we
choose serverless?
Choosing serverless
https://commons.wikimedia.org/wiki/File:Grasshopper_in_green_field.jpghttps://commons.wikimedia.org/wiki/File:Connochaetes_taurinus_-Wildebeest_crossing_river_-East_Africa.jpg
@ben11kehoe

Monolithic/layered Microservices
@ben11kehoe

• Latency
• Cost
• Deployment
• Discovery
• Security
@ben11kehoe

Latency & Cost
https://www.prerender.cloud/lambda-latency
@ben11kehoe

• Separation of concerns??
• Microservice SDKs
– Well-separated code
• Downside: instead of HTTP API
hiding, say, DB schema, it’s now
hidden in the SDK…on the client
side
– If I change the DB schema, I
need to update the callers as
well
– Highly-coupled deployments
• Bear with me
Latency & Cost @ben11kehoe

• So: deployments of highly-
coupled microservices
• …this is a monolith
• That’s ok!
• Code is still well-separated
• What does deployment look like?
Latency & Cost @ben11kehoe

Security
Allow: dynamodb:GetItem
@ben11kehoe

Security
record.pop('SensitiveKey')Allow: execute-api:Invoke
@ben11kehoe

• Microservices directly accessing
each other’s resources
• Red/black deployments
• CloudFront (+WAF) in front of API
Gateway
@ben11kehoe
• Latency
• Cost
• Deployment
• Discovery
• Security

• Serverless as an identity
• Testing
• What’s missing from providers
Soapbox @ben11kehoe

0 1
Soapbox
How much effort is it to provision and scale?
@ben11kehoe

• No need for complicated
abstraction layer
• Use SDK mocking
– placebo, aws-mock, etc.
– Microservice SDKs that just
use the AWS SDK to talk to
resources are now mocked
for free
Unit Testing @ben11kehoe

• Lambda env vars
• Service discovery (aaS?)
• VPC endpoints
• Automatic hash-based/ETag
versioning of Lambda
– Hash based purely on inputs
so it’s predictable
• Deployment
What’s still missing? @ben11kehoe

Proxy Stages
/red/v1/path/to/resource
red
/v1/path/to/resource
black
/v1/path/to/resource/black/v1/path/to/resource
@ben11kehoe

Proxy Stages
prod
/prod/v1/path/to/resource
red
/v1/path/to/resource
black
/v1/path/to/resource
@ben11kehoe

• Architecture: skip API Gateway
between microservices
– Lots of implications, pro and
con
– Primary driver for us is cost
• Security: CloudFront WAF is
possible for API Gateway
– A little bit of a Rube Goldberg
• Severless is a spectrum
• Integration testing only on deployed
systems
• Providers should support better
deployment models
Conclusion @ben11kehoe

Serverless operations allow iRobot to focus on building applications rather than managing infrastructure. They migrated to AWS in 2016 and now run their home production application using AWS Lambda, API Gateway, and other serverless services without any unmanaged EC2 instances. This reduces costs and improves agility compared to managing their own servers. While serverless still requires operations work, outsourcing infrastructure to AWS allows their small team to support thousands of daily Lambda deployments and the large scale of iRobot's connected robot fleet.

Micro Services Architecture

Ranjan Baisak

Should we manage events like APIs? | Alan Chatt and Kim Clark, IBM

HostedbyConfluent

APIs have become ubiquitous as a way of exposing the capabilities of the enterprise both internally and externally. However, are APIs alone enough? There is a strong resurgence in interest in asynchronous communication and event driven architecture. Applications want to receive events immediately so they can respond in real time, and furthermore they also want the benefit of being decoupled from the availability and performance characteristics of the systems providing that data. However, whilst the way that APIs are socialised, exposed, versioned etc. is well matured in the form of API management technology. We are now on the cusp of seeing first class support for event endpoint management to provide the same sophistication for discovering, exposing and consuming events.

Serverless CQRS in Azure!

BizTalk360

The CQRS pattern enables you to build highly scalable, distributed and event-driven applications. Microsoft Azure contains all the serverless building blocks you need to take advantage of the CQRS pattern. In this session, we’re going to transform a monolithic web app into a modern cloud application, that easily handles peak loads and offers great flexibility. Expect architectural guidance, cost-effective designs and live demo’s.

Journey to the Modern App with Containers, Microservices and Big Data

Lightbend

This document discusses the transition to modern enterprise applications using containers, microservices, and big data technologies. It outlines how the Datacenter Operating System (DC/OS) provides a platform for building, running, and managing modern apps at scale. DC/OS abstracts infrastructure and provides platform services to simplify developing and operating distributed apps across a datacenter. It allows organizations to innovate faster by accelerating development and deployment of new services.

Going Reactive in the Land of No

Lightbend

92% of enterprises are using the public cloud today. As a result, simply being in the cloud is no longer enough to remain competitive. The benefit of reduced costs has normalized while the market forces are demanding more innovation at faster release cycles. Enter Cloud Native! Cloud Native enables a microservices driven architecture. The shift from monolithic to microservices yields a lot of benefits - but if not done right - can quickly outweigh the benefits. The effort required in monitoring, tracing, circuit breakers, routing, load balancing, etc. for thousands of microservices can become overwhelming. This talk will address strategies to run & manage microservices from 0 to 60 using Istio and other tools in a cloud native world.

Tracking and business intelligence

Sebastian Schleicher

Intro to Knative

Christian Posta

Knative builds on Kubernetes and Istio to provide "PaaS-like abstractions" that raise the level of abstraction for specifying, running, and modifying applications. Knative includes building blocks like Knative Serving for autoscaling container workloads to zero, Knative Eventing for composing event-driven services, Knative Build for building containers from source, and Knative Pipelines for abstracting CI/CD pipelines. While Knative can run any type of container, its building blocks help enable serverless-style functions by allowing compute resources to scale to zero and be driven by event loads.

Serverless Architecture

Saul Caganoff

Changing the Game with Cloud, Microservices, and DevOps

Brian Chambers

Death of the dumb pipes: Using Apache Kafka® for Integration projects

HostedbyConfluent

Guru Sattanathan, Confluent, Senior Solutions Engineer Enterprise Integration technologies (aka Middleware) are the key enablers when it comes to Real-time data flows or Event Driven Architecture. Starting from real-time payments, e-commerce, travel booking systems, etc, everything is powered by a middleware underneath. It did transform a lot of things but with caveats! Are ESB’s & MQ’s enough for today’s integration needs? Do you know their technical debts? If you are someone looking at integrating your applications or an Integration Architect this session is for you. It's time to refresh yourself and see how organizations are building integrations today. In this session, we will go in this order: -Recap on Enterprise Integration technologies -What are the key flaws & What needs improvement? -What is Apache Kafka? -Rethinking Integration using Apache Kafka https://www.meetup.com/KafkaMelbourne/events/280590162/

Transformation During a Global Pandemic | Ashish Pandit and Scott Lee, Univer...

HostedbyConfluent

When the University of California, San Diego launched its largest investment in tech in 2018, they planned to future proof their business processes and systems. Unexpectedly, it also prepared them to handle a global pandemic that changed every norm for the campus. With shelter-in-place orders taking immediate effect, they needed to quickly set up a robust online learning platform - one with powerful analytics to track student success. And, for the times students and staff are on campus, a contact tracing application was essential for their safety. We’d like to offer a conversation with Scott Lee to tell you more about UC San Diego’s rapid transformation from a traditional, on-campus institution to one of the leading examples of remote learning, and the critical role data connectivity played in making this possible.

The Hitchhiker’s Guide to Hybrid Connectivity

BizTalk360

Organisations are increasingly becoming aware of the immense power afforded by hybrid application architectures. Enterprise businesses can now leverage the scale, elasticity, economy and global reach afforded by Microsoft Azure whilst still retaining the investment and security of their on-premises LOB systems, helping them to maintain a competitive edge in a world where businesses are no longer constrained by geographic boundaries. Yet with so many options available for connecting systems, which one should you choose? In this session we will discuss the various Microsoft offerings for hybrid connectivity including Hybrid Connections, the On-Premises Data Gateway, Virtual Private Network, Service Bus WCF Relay and the new Azure Relay – and when best to use which.

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...

Codit

This session focuses on the great opportunities that cloud integration brings to your business. Common challenges and pitfalls for hybrid messaging-based and API-based integration are discussed. Next to that, Codit's added-value approach to hybrid integration is presented, which combines a solid foundation of 15 years integration experience with an innovative and rapidly moving Azure cloud platform.

RedisConf18 - Transforming Vulnerability Telemetry with Redis Enterprise

Redis Labs

This document summarizes Malwarebytes' transformation to leverage big data and AI by building a data and AI team over 18 months. It discusses challenges around scaling to big data volumes and varieties, handling stateful and real-time data, and massive data caching needs. It then outlines architectural goals and solutions developed using Redis Enterprise to build advanced data visualizations and analytics around malware detections, including infection maps, AV failure rates over time, and malware velocity trends. Redis Enterprise helped scale to large data volumes and processing needs cost effectively with high performance and availability.

Developing custom transformation in the Kafka connect to minimize data redund...

HostedbyConfluent

Compacted topics grow over time and are often utilizing high performance, low latency and relatively expensive storage solutions. Reducing duplicated data plays a critical role in the size of compacted topics. with less data on the topics, the Kafka cluster consumes less disk space which in turn it leads to lower operation cost. in this use case-driven talk, we are going to demonstrate how our team at UnitedHealth Group leveraged existing transformers to extract data from the message metadata in the topic as well as how we developed our customized transformers to minimize the amount of duplicated data in each message in the topic.

WSO2 Intro Webinar - Simplifying Enterprise Integration with Configurable WS...

WSO2

WSO2 ESB is a lightweight and high-performance open source enterprise service bus (ESB) that simplifies enterprise integration. It provides mediation capabilities and abstractions to integrate diverse applications and protocols. WSO2 ESB's graphical tools and wizards make integration configurations easy without coding. It supports many protocols, standards, and integration patterns to enable a wide range of integration scenarios.

Javantura v3 - Microservice – no fluff the REAL stuff – Nakul Mishra

HUJAK - Hrvatska udruga Java korisnika / Croatian Java User Association

This document discusses microservices and provides an overview of common microservice concepts. It begins with discussing problems with monolithic architectures and then covers topics like service registration with Eureka, load balancing with Ribbon, edge services with Zuul, and failure management with Hystrix. Both pros and cons of the microservices approach are presented. The document concludes with an example demo of a microservices architecture using Spring Cloud and a request for any questions.

Mesh-ing around with Streams across the Enterprise | Phil Scanlon, Solace

HostedbyConfluent

Organisations are becoming Event Driven based on streaming technologies and adopting Data Mesh and Event Mesh architectures. As this becomes pervasive, so do the challenges around runtime governance and lifecycle management. For example, do you know what streams exist, who is producing and consuming them? What is the effect of upstream changes? How is this information kept up to date, and how do people collaborate efficiently across distributed teams and environments? Ever wish you had a way to view and visualize graphically the relationships between schemas, topics and applications? In this talk we will show you how to do that and get more value from your Kafka Streaming infrastructure using an Event Portal - an API portal specialized for event streams and publish/subscribe patterns. Join us to see how you can discover event streams from your Kafka clusters, import them to a catalog to see alongside other enterprise event streams and leverage code gen capabilities to ease development.

Evolving the Engineering Culture to Manage Kafka as a Service | Kate Agnew, O...

HostedbyConfluent

Embracing open source software for critical platform operations is a tough organizational evolution for a company of any size. This is particularly daunting for technology teams accustomed to a fully supported managed service. Come learn about how we are using OSS to modernize Health Care at UnitedHealth Group as a roadmap to adopt and offer OSS in your own organization! Over the last three years, Kafka as a Service within UnitedHealth Group has gone from non-existent to being centrally managed and utilized by over 200 internal application teams as an essential component to our ecosystem. In this session, I will share how to tactically implement a Kafka as a Service platform offering within any organization with a very lean team and how to get broad adoption from engineers and leadership. I'll discuss the engineering cultural changes needed, both on the DevOps team as well as more broadly, to adopt OSS. Spoiler: Documentation is the key to success. I will talk about some of our "aha" moments, including the importance of internal Terms of Service and how to encourage teams to "Google first." I will include things that haven't worked as well, such as requiring manual review of all topic creation PRs (this doesn't scale!). Attendees will learn how to both stand up their own OSS offering as well as how to be a good internal consumer of other such offerings. Come ready to learn and laugh about my journey to offering OSS to thousands of people!

Big ideas in small packages - How microservices helped us to scale our vision

Sebastian Schleicher

Blinkist started as a monolith application but transitioned to microservices as the business scaled. This allowed each part of the application to scale independently and improved development speed. Key learnings included only migrating existing features if it provided value, embracing AWS vendor lock-in while acting wisely, and building new features as microservices adhering to standards like JSON API. The monolith validated their product vision while microservices helped scale the business through a stable, automated infrastructure.

Apache Kafka and the Data Mesh | Michael Noll, Confluent

HostedbyConfluent

Data mesh is a relatively recent term that describes a set of principles that good modern data systems uphold. A kind of “microservices” for the data-centric world. While the data mesh is not technology-specific as a pattern, the building of systems that adopt and implement data mesh principles have a relatively long history under different guises. In this talk, we share our recommendations and picks of what every developer should know about building a streaming data mesh with Kafka. We introduce the four principles of the data mesh: domain-driven decentralization, data as a product, self-service data platform, and federated governance. We then cover topics such as the differences between working with event streams versus centralized approaches and highlight the key characteristics that make streams a great fit for implementing a mesh, such as their ability to capture both real-time and historical data. We’ll examine how to onboard data from existing systems into a mesh, modelling the communication within the mesh, how to deal with changes to your domain’s “public” data, give examples of global standards for governance, and discuss the importance of taking a product-centric view on data sources and the data sets they share.

Serverless, oui mais pour quels usages ?

VMware Tanzu

The document discusses serverless computing and its uses, noting that it can provide flexibility and efficiency but also lacks standards. It provides examples of common use cases for serverless functions like event-based integration, file processing, and web event stream processing. The document also introduces Pivotal Function Service (PFS) as a runtime for serverless functions that allows triggering functions via events and running them anywhere.

Kafka Summit SF 2017 - Worldwide Scalable and Resilient Messaging Services wi...

confluent

ChatWork is a worldwide communication service, which holds 110k+ of customer organizations. In 2016, we have developed a new scalable infrastructure based on the idea of CQRS and Event Sourcing using Kafka and Kafka Streams combined with Akka and HBase. In this session, we talk about the concept of this architecture and lessons learned in production use cases. Presented at Kafka Summit SF 2017 by Masaru Dobashi and Shingo Omura

AWS Innovate 2016 : Opening Keynote - Glenn Gore

Amazon Web Services Korea

This document contains the agenda for the AWS Innovate conference. The keynote will be delivered by Glenn Gore from Amazon Web Services. There are multiple concurrent sessions offered throughout the day covering topics ranging from cloud migration strategies to building mobile apps to container management. Sessions are at various technical levels and include time for breaks, exhibits, and networking.

Serverless Delivery

Casey Lee

This document discusses continuous delivery fundamentals and how serverless platforms can help realize them. It covers topics like automated software releases through pipelines, building quality into products from the start, and how serverless handles infrastructure concerns so developers can focus on code. Examples are provided of using AWS Lambda, API Gateway, S3, Route53, CloudFormation, CodePipeline and other services to implement continuous delivery of serverless applications.

What's hot

Hybrid Integration with BizTalk Server - ACSUG

Wagner Silveira

Navigating a Mesh of Microservices in the new Cloud-Native World with Istio

Gary Arora

Tracking and business intelligence

Sebastian Schleicher

Intro to Knative

Christian Posta

Serverless Architecture

Saul Caganoff

Changing the Game with Cloud, Microservices, and DevOps

Brian Chambers

Death of the dumb pipes: Using Apache Kafka® for Integration projects

HostedbyConfluent

Transformation During a Global Pandemic | Ashish Pandit and Scott Lee, Univer...

HostedbyConfluent

The Hitchhiker’s Guide to Hybrid Connectivity

BizTalk360

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...

Codit

RedisConf18 - Transforming Vulnerability Telemetry with Redis Enterprise

Redis Labs

Developing custom transformation in the Kafka connect to minimize data redund...

HostedbyConfluent

WSO2 Intro Webinar - Simplifying Enterprise Integration with Configurable WS...

WSO2

Javantura v3 - Microservice – no fluff the REAL stuff – Nakul Mishra

HUJAK - Hrvatska udruga Java korisnika / Croatian Java User Association

Mesh-ing around with Streams across the Enterprise | Phil Scanlon, Solace

HostedbyConfluent

Evolving the Engineering Culture to Manage Kafka as a Service | Kate Agnew, O...

HostedbyConfluent

Big ideas in small packages - How microservices helped us to scale our vision

Sebastian Schleicher

Apache Kafka and the Data Mesh | Michael Noll, Confluent

HostedbyConfluent

Serverless, oui mais pour quels usages ?

VMware Tanzu

Kafka Summit SF 2017 - Worldwide Scalable and Resilient Messaging Services wi...

confluent

What's hot (20)