SlideShare a Scribd company logo
1 of 19
Download to read offline
Do NOT click-ops your
data infrastructure
Dewan Ahmed
Hi, I’m Dewan
• Senior Developer Advocate, Aiven

• New Brunswick, Canada

• Focus on app/data infrastructure

• Pro bono career coach
in/diahmed | @DewanAhmed
A story of clicks…
Application Infrastructure
in/diahmed | @DewanAhmed
@aiven_io
Why do we build applications?
To move data
@aiven_io in/diahmed | @DewanAhmed
Data Infrastructure
in/diahmed | @DewanAhmed
@aiven_io
Infrastructure-as-Code Principles
•Reproducibility

•Repeatability

•Disposability

•Consistency

•Ability to incorporate design changes
in/diahmed | @DewanAhmed
More in the book:
Infrastructure as Code (Kief Morris)
@aiven_io
Infrastructure-as-Code Challenges
• Resistance to learning

• Con
fi
guration drift

• Duplicate work

• Security issues*

• Handling unicorns

in/diahmed | @DewanAhmed
*Source: https://bridgecrew.io/blog/state-of-open-source-terraform-security-report-2020
@aiven_io
Handling Unicorns - Databases
• Perform version upgrade

• Prevent version upgrade

• Change con
fi
gurations
in/diahmed | @DewanAhmed
How to IaC without downtime
@aiven_io
in/diahmed | @DewanAhmed
@aiven_io
Aiven Terraform Provider
in/diahmed | @DewanAhmed
Source: https://www.terraform.io/intro
@aiven_io
in/diahmed | @DewanAhmed
Reproducibility
@aiven_io
in/diahmed | @DewanAhmed
Repeatability
Consistency
@aiven_io
in/diahmed | @DewanAhmed
Apache Kafka® and Apache Kafka® MirrorMaker 2
@aiven_io
DEMO!
in/diahmed | @DewanAhmed
But… How do I start?
• Research - is this right for us?

• Awareness - are we ready for this?

• Principles - Do you know the fundamentals?

• Pilot - Let’s get something working

• All-in Strategy - Roll-out where it makes sense
in/diahmed | @DewanAhmed
@aiven_io
Recap
•Infrastructure-as-Code (IaC) principles

•Challenges and concerns - IaC with
data infrastructure

•How to get started in your IaC journey?
in/diahmed | @DewanAhmed
@aiven_io
• Aiven Terraform Provider: https://developer.aiven.io/docs/tools/
terraform.html

• Demo: https://developer.aiven.io/docs/tools/terraform/reference/
cookbook/kafka-mirrormaker-recipe.html

• IaC Blog: https://www.dewanahmed.com/iac-principles-patterns
References:
in/diahmed | @DewanAhmed
@aiven_io
Questions?


dewan@aiven.io
in/diahmed | @DewanAhmed
@aiven_io

More Related Content

Similar to stackconf 2022: Do NOT click-ops your data infrastructure

Data-Ed Online: Approaching Data Quality
Data-Ed Online: Approaching Data QualityData-Ed Online: Approaching Data Quality
Data-Ed Online: Approaching Data Quality
DATAVERSITY
 
Implementing and Managing Desktop Virtualization in Education
Implementing and Managing Desktop Virtualization in EducationImplementing and Managing Desktop Virtualization in Education
Implementing and Managing Desktop Virtualization in Education
Jeremy Anderson
 
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
HemaMaliniP5
 

Similar to stackconf 2022: Do NOT click-ops your data infrastructure (20)

Data-Ed Online: Approaching Data Quality
Data-Ed Online: Approaching Data QualityData-Ed Online: Approaching Data Quality
Data-Ed Online: Approaching Data Quality
 
Implementing and Managing Desktop Virtualization in Education
Implementing and Managing Desktop Virtualization in EducationImplementing and Managing Desktop Virtualization in Education
Implementing and Managing Desktop Virtualization in Education
 
Eric Blassin (Lionbridge) at the Industry Leaders Forum 2015
Eric Blassin (Lionbridge) at the Industry Leaders Forum 2015Eric Blassin (Lionbridge) at the Industry Leaders Forum 2015
Eric Blassin (Lionbridge) at the Industry Leaders Forum 2015
 
Everything To Everybody? Making Your Denodo Implementation a Huge Success
Everything To Everybody? Making Your Denodo Implementation a Huge SuccessEverything To Everybody? Making Your Denodo Implementation a Huge Success
Everything To Everybody? Making Your Denodo Implementation a Huge Success
 
Data Management vs. Data Governance Program
Data Management vs. Data Governance ProgramData Management vs. Data Governance Program
Data Management vs. Data Governance Program
 
Cloud computing came to stay
Cloud computing came to stayCloud computing came to stay
Cloud computing came to stay
 
Conceptual vs. Logical vs. Physical Data Modeling
Conceptual vs. Logical vs. Physical Data ModelingConceptual vs. Logical vs. Physical Data Modeling
Conceptual vs. Logical vs. Physical Data Modeling
 
Developing a cloud strategy - Presentation Nexon ABC Event
Developing a cloud strategy - Presentation Nexon ABC EventDeveloping a cloud strategy - Presentation Nexon ABC Event
Developing a cloud strategy - Presentation Nexon ABC Event
 
Software Defined Networking - Next-Gen Enterprise Networks
Software Defined Networking - Next-Gen Enterprise NetworksSoftware Defined Networking - Next-Gen Enterprise Networks
Software Defined Networking - Next-Gen Enterprise Networks
 
Case Study - Building a Website for Vocational Training and Education
Case Study - Building a Website for Vocational Training and EducationCase Study - Building a Website for Vocational Training and Education
Case Study - Building a Website for Vocational Training and Education
 
Preparing Big Data for Analysis with Easyl
Preparing Big Data for Analysis with EasylPreparing Big Data for Analysis with Easyl
Preparing Big Data for Analysis with Easyl
 
Approaching Data Quality
Approaching Data QualityApproaching Data Quality
Approaching Data Quality
 
CloudExpo NY 2014: Moving Mission Critical Applications to the Cloud
CloudExpo NY 2014: Moving Mission Critical Applications to the CloudCloudExpo NY 2014: Moving Mission Critical Applications to the Cloud
CloudExpo NY 2014: Moving Mission Critical Applications to the Cloud
 
Responsive Web Design: How the mobile web has changed the way we think and work
Responsive Web Design:  How the mobile web has changed the way we think and workResponsive Web Design:  How the mobile web has changed the way we think and work
Responsive Web Design: How the mobile web has changed the way we think and work
 
Girl Geek Dinner
Girl Geek DinnerGirl Geek Dinner
Girl Geek Dinner
 
Neo4j + Process Tempo present Plan Your Cloud Migration with Confidence
Neo4j + Process Tempo present Plan Your Cloud Migration with ConfidenceNeo4j + Process Tempo present Plan Your Cloud Migration with Confidence
Neo4j + Process Tempo present Plan Your Cloud Migration with Confidence
 
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
How DeepSphere.AI Transformed Fresh Graduates Into Data Scientists At Databri...
 
IoT Architecture - are traditional architectures good enough or do we need n...
 IoT Architecture - are traditional architectures good enough or do we need n... IoT Architecture - are traditional architectures good enough or do we need n...
IoT Architecture - are traditional architectures good enough or do we need n...
 
The Advent of Serverless Technologies
The Advent of Serverless TechnologiesThe Advent of Serverless Technologies
The Advent of Serverless Technologies
 
Enhance your multi-cloud application performance using Redis Enterprise P1
Enhance your multi-cloud application performance using Redis Enterprise P1Enhance your multi-cloud application performance using Redis Enterprise P1
Enhance your multi-cloud application performance using Redis Enterprise P1
 

Recently uploaded

Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 

Recently uploaded (20)

Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideCollecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 

stackconf 2022: Do NOT click-ops your data infrastructure