SlideShare a Scribd company logo
Thank you
Highly Operationalized NoOps -
How Craftsy uses Lambda
Matthew Boeckman
VP - Infrastructure
@matthewboeckman
matthew@craftsy.com
sshhhhhh it’s a secret
I hate NoOps
NoOps implies we don’t kNOw what’s going on
NoOps would be great in a perfectly spherical,
frictionless chicken computing environment
The History of Computing
… as told by your humble narrator
A history lesson!
20 years ago, everything was physical servers
Couple applications per host at best
You were managing:
racks
power
cooling
screws and captive nuts
server lifts
cable ladders
ethernet cables
rack ears
switches
network addressing
routers
firewalls
server hardware (drives, etc)
operating system
GNU suite (take that Stallman!)
application engines
code
A history lesson!
10 years ago, we virtualized everything
Massive density - dozens of hosts per machine
You were still managing:
racks
power
cooling
screws and captive nuts
server lifts
cable ladders
ethernet cables
rack ears
switches
network addressing
routers
firewalls
server hardware (drives, etc)
Operating System
GNU suite (take that Stallman!)
application engines
code
But now also:
Hypervisors!
Hooray DevOps!
5 years ago, There Became A Cloud
Holy crap
Now you’re managing
racks
power
cooling
screws and captive nuts
server lifts
cable ladders
ethernet cables
rack ears
switches
network addressing
routers
firewalls
server hardware (drives, etc)
Operating System
GNU suite (take that Stallman!)
application engines
code
But now also:
Hypervisors!
Cloud Management Interface
Puppet/Chef/Ansible
A history lesson!
2 years ago, we virtualized virtualization
this is getting silly
Now you’re managing
racks
power
cooling
screws and captive nuts
server lifts
cable ladders
ethernet cables
rack ears
switches
network addressing
routers
firewalls
server hardware (drives, etc)
Operating System
GNU suite (take that Stallman!)
application engines
code
But now also:
Hypervisors!
Cloud Management Interface
Container stuff
Puppet/Chef/Ansible
A history lesson!
screw it, let’s just quit managing everything Now you’re managing
racks
power
cooling
screws and captive nuts
server lifts
cable ladders
ethernet cables
rack ears
switches
network addressing
routers
firewalls
server hardware (drives, etc)
Operating System
GNU suite (take that Stallman!)
application engines
code
But now also:
Hypervisors!
Cloud Management Interface
Puppet/Chef/Ansible
What is Lambda?
Lambda is the logical conclusion of the progressive layers of
abstraction that now separate us from our Ops roots.
Lambda is an event-driven, compute service that automatically
manages everything under your code.
Lambda is stateless. Lambda scales ... all the way.
I hate words
Lambda functions are initiated as a result of an event from multiple
possible input sources
What’s going on in there?
Uses
● Real-time log processing
● Media manipulation (image resize, crop, replication)
● Lightweight ETL functions
● “Stored procedures” in Dynamo (every DBA is cringing)
● Data shipping/backups
Any stateless, event driven operation!
Cost
Per-Request
● First 1 million requests per month are free
● $0.20 per 1 million requests thereafter ($0.0000002 per request)
Per GB-Second
● $0.00001667 per GB-Second of memory used
Talk about a hard sell
I thought you hated NoOps?
What if it breaks?
All the output
All the details
Execution time, performance deets
Highly Operationalized NoOps
“All the art of living lies in a
fine mingling of letting go
and holding on.”
― Henry Havelock Ellis

More Related Content

What's hot

E2E Data Pipeline - Apache Spark/Airflow/Livy
E2E Data Pipeline - Apache Spark/Airflow/LivyE2E Data Pipeline - Apache Spark/Airflow/Livy
E2E Data Pipeline - Apache Spark/Airflow/Livy
Rikin Tanna
 
Docker in der AWS Cloud
Docker in der AWS CloudDocker in der AWS Cloud
Docker in der AWS Cloud
Sascha Möllering
 
Denver AWS Users' Group Meeting - July 2018 Slides
Denver AWS Users' Group Meeting - July 2018 SlidesDenver AWS Users' Group Meeting - July 2018 Slides
Denver AWS Users' Group Meeting - July 2018 Slides
David McDaniel
 
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
Quentin Adam
 
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Codemotion
 
GreenButton-201502
GreenButton-201502GreenButton-201502
GreenButton-201502
Jonathan Kalbfeld, MBA
 
NTS: What We Do With OpenNebula - and Why We Do It
NTS: What We Do With OpenNebula - and Why We Do ItNTS: What We Do With OpenNebula - and Why We Do It
NTS: What We Do With OpenNebula - and Why We Do It
OpenNebula Project
 
Docker in der Cloud
Docker in der CloudDocker in der Cloud
Docker in der Cloud
Sascha Möllering
 
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Problems you’ll face in the Microservices World: Configuration, Authenticatio...Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Quentin Adam
 
Devops with ansible
Devops with ansibleDevops with ansible
Devops with ansible
Edwin Cruz
 
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Quentin Adam
 
Cloudsolutionday 2016: Docker & FAAS at getvero.com
Cloudsolutionday 2016: Docker & FAAS at getvero.comCloudsolutionday 2016: Docker & FAAS at getvero.com
Cloudsolutionday 2016: Docker & FAAS at getvero.com
AWS Vietnam Community
 
Exploring Serverless Architectures: AWS Lambda
Exploring Serverless Architectures: AWS LambdaExploring Serverless Architectures: AWS Lambda
Exploring Serverless Architectures: AWS Lambda
Alex Klibisz
 
Serverless Empowering people
Serverless Empowering peopleServerless Empowering people
Serverless Empowering people
Marcia Villalba
 
Thinkbox Software
Thinkbox SoftwareThinkbox Software
Thinkbox Software
Amazon Web Services
 
BBC's GraphDB (formerly Owlim) AWS Cloud Migration
BBC's GraphDB (formerly Owlim) AWS Cloud MigrationBBC's GraphDB (formerly Owlim) AWS Cloud Migration
BBC's GraphDB (formerly Owlim) AWS Cloud Migration
logomachy
 
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
Yanik Berube
 
JUST EAT: Embracing DevOps
JUST EAT: Embracing DevOpsJUST EAT: Embracing DevOps
JUST EAT: Embracing DevOps
Peter Mounce
 
Meetup #3: Migrating an Oracle Application from on-premise to AWS
Meetup #3: Migrating an Oracle Application from on-premise to AWSMeetup #3: Migrating an Oracle Application from on-premise to AWS
Meetup #3: Migrating an Oracle Application from on-premise to AWS
AWS Vietnam Community
 
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
OpenNebula Project
 

What's hot (20)

E2E Data Pipeline - Apache Spark/Airflow/Livy
E2E Data Pipeline - Apache Spark/Airflow/LivyE2E Data Pipeline - Apache Spark/Airflow/Livy
E2E Data Pipeline - Apache Spark/Airflow/Livy
 
Docker in der AWS Cloud
Docker in der AWS CloudDocker in der AWS Cloud
Docker in der AWS Cloud
 
Denver AWS Users' Group Meeting - July 2018 Slides
Denver AWS Users' Group Meeting - July 2018 SlidesDenver AWS Users' Group Meeting - July 2018 Slides
Denver AWS Users' Group Meeting - July 2018 Slides
 
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017
 
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
Microservices: 5 things I wish I'd known - Vincent Kok - Codemotion Amsterdam...
 
GreenButton-201502
GreenButton-201502GreenButton-201502
GreenButton-201502
 
NTS: What We Do With OpenNebula - and Why We Do It
NTS: What We Do With OpenNebula - and Why We Do ItNTS: What We Do With OpenNebula - and Why We Do It
NTS: What We Do With OpenNebula - and Why We Do It
 
Docker in der Cloud
Docker in der CloudDocker in der Cloud
Docker in der Cloud
 
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Problems you’ll face in the Microservices World: Configuration, Authenticatio...Problems you’ll face in the Microservices World: Configuration, Authenticatio...
Problems you’ll face in the Microservices World: Configuration, Authenticatio...
 
Devops with ansible
Devops with ansibleDevops with ansible
Devops with ansible
 
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017
 
Cloudsolutionday 2016: Docker & FAAS at getvero.com
Cloudsolutionday 2016: Docker & FAAS at getvero.comCloudsolutionday 2016: Docker & FAAS at getvero.com
Cloudsolutionday 2016: Docker & FAAS at getvero.com
 
Exploring Serverless Architectures: AWS Lambda
Exploring Serverless Architectures: AWS LambdaExploring Serverless Architectures: AWS Lambda
Exploring Serverless Architectures: AWS Lambda
 
Serverless Empowering people
Serverless Empowering peopleServerless Empowering people
Serverless Empowering people
 
Thinkbox Software
Thinkbox SoftwareThinkbox Software
Thinkbox Software
 
BBC's GraphDB (formerly Owlim) AWS Cloud Migration
BBC's GraphDB (formerly Owlim) AWS Cloud MigrationBBC's GraphDB (formerly Owlim) AWS Cloud Migration
BBC's GraphDB (formerly Owlim) AWS Cloud Migration
 
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
Scala + Akka + ning/async-http-client - Vancouver Scala meetup February 2015
 
JUST EAT: Embracing DevOps
JUST EAT: Embracing DevOpsJUST EAT: Embracing DevOps
JUST EAT: Embracing DevOps
 
Meetup #3: Migrating an Oracle Application from on-premise to AWS
Meetup #3: Migrating an Oracle Application from on-premise to AWSMeetup #3: Migrating an Oracle Application from on-premise to AWS
Meetup #3: Migrating an Oracle Application from on-premise to AWS
 
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...
 

Viewers also liked

NoOps != No Operations
NoOps != No OperationsNoOps != No Operations
NoOps != No Operations
David Tesar
 
Going Serverless: The Best Ops is NoOps.
Going Serverless: The Best Ops is NoOps.Going Serverless: The Best Ops is NoOps.
Going Serverless: The Best Ops is NoOps.
PolarSeven Pty Ltd
 
An agile introduction to DevOps
An agile introduction to DevOpsAn agile introduction to DevOps
An agile introduction to DevOps
Gil Zilberfeld
 
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
Amazon Web Services
 
New Data Governance Lambda architecute
New Data Governance Lambda architecuteNew Data Governance Lambda architecute
New Data Governance Lambda architecute
Ricardo Jorge Polero Baraldi
 
Moods of Norway
Moods of NorwayMoods of Norway
Moods of Norway
Innovation Norway
 
111114 Tc Trading During Turbulent Times Ver2
111114 Tc Trading During Turbulent Times   Ver2111114 Tc Trading During Turbulent Times   Ver2
111114 Tc Trading During Turbulent Times Ver2
joeforexyard
 
807 image gallery by wordpress
807 image gallery by wordpress807 image gallery by wordpress
807 image gallery by wordpress
Satoru Hoshiba
 
Using Social Media for Professional and Educational Purposes
Using Social Media for Professional and Educational PurposesUsing Social Media for Professional and Educational Purposes
Using Social Media for Professional and Educational Purposes
Sherrie Lee
 
Marketing and Business Development Manager - SS - 160705
Marketing and Business Development Manager - SS - 160705Marketing and Business Development Manager - SS - 160705
Marketing and Business Development Manager - SS - 160705
Sandeep Saib
 
LinkedIn has 200 million users!
LinkedIn has 200 million users!LinkedIn has 200 million users!
LinkedIn has 200 million users!
Amit Ranjan
 
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
Amit Ranjan
 
1 26-11 presentation
1 26-11 presentation1 26-11 presentation
1 26-11 presentation
Tony Veteto
 
Inday LearnIn: What can SlideShare learn from other organisations?
Inday LearnIn: What can SlideShare learn from other organisations?Inday LearnIn: What can SlideShare learn from other organisations?
Inday LearnIn: What can SlideShare learn from other organisations?
Amit Ranjan
 
Information Literacy in the Age of YouTube
Information Literacy in the Age of YouTubeInformation Literacy in the Age of YouTube
Information Literacy in the Age of YouTube
M.J. D'Elia
 

Viewers also liked (16)

NoOps != No Operations
NoOps != No OperationsNoOps != No Operations
NoOps != No Operations
 
Going Serverless: The Best Ops is NoOps.
Going Serverless: The Best Ops is NoOps.Going Serverless: The Best Ops is NoOps.
Going Serverless: The Best Ops is NoOps.
 
An agile introduction to DevOps
An agile introduction to DevOpsAn agile introduction to DevOps
An agile introduction to DevOps
 
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
AWS re:Invent 2016: Disrupting Big Data with Cost-effective Compute (CMP302)
 
New Data Governance Lambda architecute
New Data Governance Lambda architecuteNew Data Governance Lambda architecute
New Data Governance Lambda architecute
 
Moods of Norway
Moods of NorwayMoods of Norway
Moods of Norway
 
111114 Tc Trading During Turbulent Times Ver2
111114 Tc Trading During Turbulent Times   Ver2111114 Tc Trading During Turbulent Times   Ver2
111114 Tc Trading During Turbulent Times Ver2
 
De Koers
De KoersDe Koers
De Koers
 
807 image gallery by wordpress
807 image gallery by wordpress807 image gallery by wordpress
807 image gallery by wordpress
 
Using Social Media for Professional and Educational Purposes
Using Social Media for Professional and Educational PurposesUsing Social Media for Professional and Educational Purposes
Using Social Media for Professional and Educational Purposes
 
Marketing and Business Development Manager - SS - 160705
Marketing and Business Development Manager - SS - 160705Marketing and Business Development Manager - SS - 160705
Marketing and Business Development Manager - SS - 160705
 
LinkedIn has 200 million users!
LinkedIn has 200 million users!LinkedIn has 200 million users!
LinkedIn has 200 million users!
 
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
Meet Thirst, Shift Happens, Footnotes & Panipuri (conference rooms at SlideSh...
 
1 26-11 presentation
1 26-11 presentation1 26-11 presentation
1 26-11 presentation
 
Inday LearnIn: What can SlideShare learn from other organisations?
Inday LearnIn: What can SlideShare learn from other organisations?Inday LearnIn: What can SlideShare learn from other organisations?
Inday LearnIn: What can SlideShare learn from other organisations?
 
Information Literacy in the Age of YouTube
Information Literacy in the Age of YouTubeInformation Literacy in the Age of YouTube
Information Literacy in the Age of YouTube
 

Similar to Ops, DevOps, NoOps and AWS Lambda

Building services on AWS in China region
Building services on AWS in China regionBuilding services on AWS in China region
Building services on AWS in China region
Roman Naumenko
 
The Netflix Way to deal with Big Data Problems
The Netflix Way to deal with Big Data ProblemsThe Netflix Way to deal with Big Data Problems
The Netflix Way to deal with Big Data Problems
Monal Daxini
 
Lightbend Fast Data Platform
Lightbend Fast Data PlatformLightbend Fast Data Platform
Lightbend Fast Data Platform
Lightbend
 
The internet of $h1t
The internet of $h1tThe internet of $h1t
The internet of $h1t
Amit Serper
 
The advantages of Arista/OVH configurations, and the technologies behind buil...
The advantages of Arista/OVH configurations, and the technologies behind buil...The advantages of Arista/OVH configurations, and the technologies behind buil...
The advantages of Arista/OVH configurations, and the technologies behind buil...
OVHcloud
 
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Barney Hanlon
 
John adams talk cloudy
John adams   talk cloudyJohn adams   talk cloudy
John adams talk cloudy
John Adams
 
The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)
Yan Cui
 
The present and future of Serverless observability
The present and future of Serverless observabilityThe present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
 
The present and future of Serverless observability
The present and future of Serverless observabilityThe present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
 
Netflix keystone streaming data pipeline @scale in the cloud-dbtb-2016
Netflix keystone   streaming data pipeline @scale in the cloud-dbtb-2016Netflix keystone   streaming data pipeline @scale in the cloud-dbtb-2016
Netflix keystone streaming data pipeline @scale in the cloud-dbtb-2016
Monal Daxini
 
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
Igalia
 
Clouds: All fluff and no substance?
Clouds: All fluff and no substance?Clouds: All fluff and no substance?
Clouds: All fluff and no substance?
Guy Coates
 
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
ChinaNetCloud
 
Lightbend Fast Data Platform
Lightbend Fast Data PlatformLightbend Fast Data Platform
Lightbend Fast Data Platform
Lightbend
 
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner NeunteuflNagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
NETWAYS
 
Chris Boos No Cloud Without Automation
Chris Boos   No Cloud Without AutomationChris Boos   No Cloud Without Automation
Chris Boos No Cloud Without Automation
Cloudcamp
 
BruCON 2010 Lightning Talks - DIY Grid Computing
BruCON 2010 Lightning Talks - DIY Grid ComputingBruCON 2010 Lightning Talks - DIY Grid Computing
BruCON 2010 Lightning Talks - DIY Grid Computing
tomaszmiklas
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 

Similar to Ops, DevOps, NoOps and AWS Lambda (20)

Building services on AWS in China region
Building services on AWS in China regionBuilding services on AWS in China region
Building services on AWS in China region
 
The Netflix Way to deal with Big Data Problems
The Netflix Way to deal with Big Data ProblemsThe Netflix Way to deal with Big Data Problems
The Netflix Way to deal with Big Data Problems
 
Lightbend Fast Data Platform
Lightbend Fast Data PlatformLightbend Fast Data Platform
Lightbend Fast Data Platform
 
The internet of $h1t
The internet of $h1tThe internet of $h1t
The internet of $h1t
 
The advantages of Arista/OVH configurations, and the technologies behind buil...
The advantages of Arista/OVH configurations, and the technologies behind buil...The advantages of Arista/OVH configurations, and the technologies behind buil...
The advantages of Arista/OVH configurations, and the technologies behind buil...
 
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
Command & [e]Mission Control: Using Command and Event Buses to create a CQRS-...
 
John adams talk cloudy
John adams   talk cloudyJohn adams   talk cloudy
John adams talk cloudy
 
The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)
 
The present and future of Serverless observability
The present and future of Serverless observabilityThe present and future of Serverless observability
The present and future of Serverless observability
 
The present and future of Serverless observability
The present and future of Serverless observabilityThe present and future of Serverless observability
The present and future of Serverless observability
 
Netflix keystone streaming data pipeline @scale in the cloud-dbtb-2016
Netflix keystone   streaming data pipeline @scale in the cloud-dbtb-2016Netflix keystone   streaming data pipeline @scale in the cloud-dbtb-2016
Netflix keystone streaming data pipeline @scale in the cloud-dbtb-2016
 
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
Production high-performance networking with Snabb and LuaJIT (Linux.conf.au 2...
 
Clouds: All fluff and no substance?
Clouds: All fluff and no substance?Clouds: All fluff and no substance?
Clouds: All fluff and no substance?
 
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014
 
Lightbend Fast Data Platform
Lightbend Fast Data PlatformLightbend Fast Data Platform
Lightbend Fast Data Platform
 
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner NeunteuflNagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
 
Chris Boos No Cloud Without Automation
Chris Boos   No Cloud Without AutomationChris Boos   No Cloud Without Automation
Chris Boos No Cloud Without Automation
 
BruCON 2010 Lightning Talks - DIY Grid Computing
BruCON 2010 Lightning Talks - DIY Grid ComputingBruCON 2010 Lightning Talks - DIY Grid Computing
BruCON 2010 Lightning Talks - DIY Grid Computing
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
 

More from Matthew Boeckman

Useful flakes - The Value of Common Tools
Useful flakes - The Value of Common ToolsUseful flakes - The Value of Common Tools
Useful flakes - The Value of Common Tools
Matthew Boeckman
 
All Day DevOps 2017 - There is No Root Cause
All Day DevOps 2017 - There is No Root CauseAll Day DevOps 2017 - There is No Root Cause
All Day DevOps 2017 - There is No Root Cause
Matthew Boeckman
 
Rewriting DevOps - Lessons from a 15 month software rewrite
Rewriting DevOps - Lessons from a 15 month software rewriteRewriting DevOps - Lessons from a 15 month software rewrite
Rewriting DevOps - Lessons from a 15 month software rewrite
Matthew Boeckman
 
Top 10 Practices of Highly Successful DevOps Incident Management Teams
Top 10 Practices of Highly Successful DevOps Incident Management TeamsTop 10 Practices of Highly Successful DevOps Incident Management Teams
Top 10 Practices of Highly Successful DevOps Incident Management Teams
Matthew Boeckman
 
Many hands make light work
Many hands make light workMany hands make light work
Many hands make light work
Matthew Boeckman
 
Sandstorm or Significant? The evolving role of situational context in inciden...
Sandstorm or Significant? The evolving role of situational context in inciden...Sandstorm or Significant? The evolving role of situational context in inciden...
Sandstorm or Significant? The evolving role of situational context in inciden...
Matthew Boeckman
 
Rewriting DevOps
Rewriting DevOpsRewriting DevOps
Rewriting DevOps
Matthew Boeckman
 
Go Rin no Show - DevOpsDays Rockies
Go Rin no Show - DevOpsDays RockiesGo Rin no Show - DevOpsDays Rockies
Go Rin no Show - DevOpsDays Rockies
Matthew Boeckman
 
S3 & Glacier - The only backup solution you'll ever need
S3 & Glacier - The only backup solution you'll ever needS3 & Glacier - The only backup solution you'll ever need
S3 & Glacier - The only backup solution you'll ever need
Matthew Boeckman
 

More from Matthew Boeckman (9)

Useful flakes - The Value of Common Tools
Useful flakes - The Value of Common ToolsUseful flakes - The Value of Common Tools
Useful flakes - The Value of Common Tools
 
All Day DevOps 2017 - There is No Root Cause
All Day DevOps 2017 - There is No Root CauseAll Day DevOps 2017 - There is No Root Cause
All Day DevOps 2017 - There is No Root Cause
 
Rewriting DevOps - Lessons from a 15 month software rewrite
Rewriting DevOps - Lessons from a 15 month software rewriteRewriting DevOps - Lessons from a 15 month software rewrite
Rewriting DevOps - Lessons from a 15 month software rewrite
 
Top 10 Practices of Highly Successful DevOps Incident Management Teams
Top 10 Practices of Highly Successful DevOps Incident Management TeamsTop 10 Practices of Highly Successful DevOps Incident Management Teams
Top 10 Practices of Highly Successful DevOps Incident Management Teams
 
Many hands make light work
Many hands make light workMany hands make light work
Many hands make light work
 
Sandstorm or Significant? The evolving role of situational context in inciden...
Sandstorm or Significant? The evolving role of situational context in inciden...Sandstorm or Significant? The evolving role of situational context in inciden...
Sandstorm or Significant? The evolving role of situational context in inciden...
 
Rewriting DevOps
Rewriting DevOpsRewriting DevOps
Rewriting DevOps
 
Go Rin no Show - DevOpsDays Rockies
Go Rin no Show - DevOpsDays RockiesGo Rin no Show - DevOpsDays Rockies
Go Rin no Show - DevOpsDays Rockies
 
S3 & Glacier - The only backup solution you'll ever need
S3 & Glacier - The only backup solution you'll ever needS3 & Glacier - The only backup solution you'll ever need
S3 & Glacier - The only backup solution you'll ever need
 

Recently uploaded

Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 

Recently uploaded (20)

Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 

Ops, DevOps, NoOps and AWS Lambda

  • 1. Thank you Highly Operationalized NoOps - How Craftsy uses Lambda Matthew Boeckman VP - Infrastructure @matthewboeckman matthew@craftsy.com
  • 2. sshhhhhh it’s a secret I hate NoOps NoOps implies we don’t kNOw what’s going on NoOps would be great in a perfectly spherical, frictionless chicken computing environment
  • 3. The History of Computing … as told by your humble narrator
  • 4. A history lesson! 20 years ago, everything was physical servers Couple applications per host at best You were managing: racks power cooling screws and captive nuts server lifts cable ladders ethernet cables rack ears switches network addressing routers firewalls server hardware (drives, etc) operating system GNU suite (take that Stallman!) application engines code
  • 5. A history lesson! 10 years ago, we virtualized everything Massive density - dozens of hosts per machine You were still managing: racks power cooling screws and captive nuts server lifts cable ladders ethernet cables rack ears switches network addressing routers firewalls server hardware (drives, etc) Operating System GNU suite (take that Stallman!) application engines code But now also: Hypervisors!
  • 6. Hooray DevOps! 5 years ago, There Became A Cloud Holy crap Now you’re managing racks power cooling screws and captive nuts server lifts cable ladders ethernet cables rack ears switches network addressing routers firewalls server hardware (drives, etc) Operating System GNU suite (take that Stallman!) application engines code But now also: Hypervisors! Cloud Management Interface Puppet/Chef/Ansible
  • 7. A history lesson! 2 years ago, we virtualized virtualization this is getting silly Now you’re managing racks power cooling screws and captive nuts server lifts cable ladders ethernet cables rack ears switches network addressing routers firewalls server hardware (drives, etc) Operating System GNU suite (take that Stallman!) application engines code But now also: Hypervisors! Cloud Management Interface Container stuff Puppet/Chef/Ansible
  • 8. A history lesson! screw it, let’s just quit managing everything Now you’re managing racks power cooling screws and captive nuts server lifts cable ladders ethernet cables rack ears switches network addressing routers firewalls server hardware (drives, etc) Operating System GNU suite (take that Stallman!) application engines code But now also: Hypervisors! Cloud Management Interface Puppet/Chef/Ansible
  • 9. What is Lambda? Lambda is the logical conclusion of the progressive layers of abstraction that now separate us from our Ops roots. Lambda is an event-driven, compute service that automatically manages everything under your code. Lambda is stateless. Lambda scales ... all the way.
  • 10. I hate words Lambda functions are initiated as a result of an event from multiple possible input sources
  • 11. What’s going on in there?
  • 12. Uses ● Real-time log processing ● Media manipulation (image resize, crop, replication) ● Lightweight ETL functions ● “Stored procedures” in Dynamo (every DBA is cringing) ● Data shipping/backups Any stateless, event driven operation!
  • 13. Cost Per-Request ● First 1 million requests per month are free ● $0.20 per 1 million requests thereafter ($0.0000002 per request) Per GB-Second ● $0.00001667 per GB-Second of memory used
  • 14. Talk about a hard sell
  • 15. I thought you hated NoOps?
  • 16. What if it breaks?
  • 20. Highly Operationalized NoOps “All the art of living lies in a fine mingling of letting go and holding on.” ― Henry Havelock Ellis