SlideShare a Scribd company logo
DevTestOps
Cultural Change Through
Quality Assurance
Module 1 - Talk the Talk
Module Contents
What is DevOps?
What is DevTestOps?
Module Objectives
❏ Learn, comprehend and practice DevOps principles and
fundamentals
❏ Understanding of where testing plays a part
❏ Become a competent and courageous DevOps
Team member.
Module Contents...
VM Basics
https://www.virtualbox.org/
https://www.centos.org/download/
Docker Basics
https://store.docker.com/editions/community/docker-ce-server-centos
Source Code Management
https://git-scm.com/
What is DevOps?
The WIKI definition of DevOps
DevOps is a software engineering practice that
aims at unifying software development (Dev) and
software operation (Ops). The main characteristic
of the DevOps movement is to strongly advocate
automation and monitoring at all steps of
software construction, from integration, testing,
releasing to deployment and infrastructure
management. DevOps aims at shorter
development cycles, increased deployment
frequency, more dependable releases, in close
alignment with business objectives
What is DevOps? Continue...
Examples of Practices?
What is DevOps? Continue...
Examples of Practices?
- Law Practice
- Accounting Practice
- Physiotherapy Practice
- Agile Practice
What is DevOps? Continue...
Examples of Practices?
- DevOps Practice
What is DevOps? Continue...
The Wall of Confusion
What is DevOps? Continue...
What is DevOps? Continue...
6 Principles of DevOps
1. Customer Centric Action
➢ Meeting customer requirements through short
feedback loops
➢ Courage to act and innovate continuously
➢ Pivot When strategy is not working
➢ Invest in products and services for customer
delight
What is DevOps? Continue...
2. Create With the End In Mind
➢ Let go of waterfall process-oriented models
➢ Act as product companies selling to real
customers
➢ All members require an engineering mindset
to envision and realise the product
What is DevOps? Continue...
3. End to End Responsibility
➢ Vertically organised teams
➢ Team is responsible till end of life
➢ Full support including quality and performance
What is DevOps? Continue...
4. Cross Functional
Autonomous Teams
➢ Fully responsible
➢ T-Shaped all rounders
➢ Hotbed for growth
What is DevOps? Continue...
5. Continuous Improvement
➢ Fail Fast
➢ Minimise waste
➢ Optimise for speed costs and ease of delivery
➢ Experimentation is paramount
➢ If it hurts do it more
What is DevOps? Continue...
6. Automate Everything You Can
➢ Adopt CI culture with high cycle rates and
instant feedback
➢ Includes infrastructure and container based
cloud platforms
➢ Synonymous with drive to renew delivery
methods
What is DevOps? Continue...
Key Elements of DevOps Teams
❏ Team Building
What is DevOps? Continue...
Key Elements of DevOps Teams
❏ Team Building
❏ CI and Problem Solving
What is DevOps? Continue...
Key Elements of DevOps Teams
❏ Team Building
❏ CI and Problem Solving
❏ Leadership and
Feedback
What is DevOps? Continue...
Key Elements of DevOps Teams
❏ Team Building
❏ CI and Problem Solving
❏ Leadership and Feedback
❏ Courage and Experimentation
What is DevOps? Continue...
Traditional Organisation Model
What is DevOps? Continue...
DevOps Organisation Model
What is DevOps? Continue...
A Common Microservice example
What is DevOps? Continue...
Solution Architecture for DevOps
What is DevOps? Continue...
Teams Supporting a Monolithic Architecture
What is DevOps? Continue...
DevOps Supporting a Microservice Architecture
What is DevOps? Continue...
Stats from Puppet
What is DevOps? Continue...
Summary
History and Definition
6 Principles of DevOps
Key Elements of DevOps Teams
Organisational Model
Solution Architecture
What is DevOps? Continue...
Questions?
pmateos@planittesting.com
@paulconsults
https://www.linkedin.com/in/paul-mateos-213b2167/
What is DevOps? Continue...
https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/06/23/devops-the-wall-of-confusion-un
derstanding-the-basics-of-devops/
https://www.mulesoft.com/resources/api/microservices-devops-better-together
https://www.devopsagileskills.org/dasa-devops-principles/
http://leanmanufacturingtools.org/77/the-seven-wastes-7-mudas/
https://www.slideshare.net/SherryChang/evolving-team-structure-in-devops
https://www.slideshare.net/DevOpstastic/support-that-devops-change-agents-need
http://www.planitdevops.com
References
What is DevOps? Continue...
https://purplegriffon.com/quizzes/devops-mini
Quiz TIme
DevTestOps
Cultural Change Through
Quality Assurance
Module 1 - Talk the Talk
What is DevTestOps?
DevOps with Quality Assurance as the
focul point
Bringing Planit’s Strengths in Agile,
Automation, Engineering and Quality
Assurance together
Implementation of Testing practices
throughout the DevOps End to End
process
What is DevTestOps? Continue...
Risk Appetites - Severity / Occurrence
What is DevTestOps? Continue...
Risk Appetites - Change of Mentality
What is DevTestOps? Continue...
Strategic Objective
What does the organisation want versus what they need?
● Speed To Market
● Product Quality
● Or Stability of the Production Environment
What is DevTestOps? Continue...
Paths To Communication - 5 Steps
1. Identify - Anyone who works outside of your team
2. Connect - Make connections with each individual
3. Invite - Widen the connection by bringing in new
people
4. Mark - Recording the communication for future
use
5. Widen - the path through activities that engage
What is DevTestOps?
Testing pyramid
● The reality is Test Automation is
expensive and takes a long time to
implement
● Micro service testing is quick to execute
but still costly to develop
● Unit testing requires dedication, discipline
and a FAITH
What is DevTestOps?
The Bug filter
● Bugs move between layers
● A good start but not complete
What is DevTestOps? Continue...
The Bug filter - Unit Sorting
Smaller bugs are caught by smaller filters while larger bugs are caught by larger
filters
What is DevTestOps? Continue...
The Bug filter - Unit Sorting
● Six layers to the DevOps bug filter.
● Top three are for testing that occurs in the development
environment
○ unit testing
○ integration testing
○ and end-to-end testing
● Bottom three are for the information that is captured in production
that can be used to detect bugs and determine product quality
○ Alerting
○ Monitoring
○ and logging
What is DevTestOps? Continue...
Creating Tests At Each Filter
Unit Testing
● TDD (Test Driven Development) is a crucial foundation
● Unit test frameworks for specific code
● Mocking services to isolate integrations
● Powerful when implemented within a CI/CD pipeline and run
against integration environments
● Can be difficult to implement is some circumstances
● GUI interactions
● Databases
● Legacy code
● As DevOps engineers, this is not optional
What is DevTestOps? Continue...
Creating Tests At Each Filter
Integration Testing
● Runs unit tests in a complex context (component)
● Bugs can be introduced from indirect interactions with other
services and applications. (System)
● Manual testing can provide great value
● Microservices is a must have architecture
● Knowledge of tools is a must for all testers
● SOUPUI
● POSTMAN
● Concept regarding NFR’s should be introduced here
● CI/CD tooling becomes essential to build, test, deploy and
then test again
● Product fitness rather than code quality
What is DevTestOps? Continue...
Creating Tests At Each Filter
End-to-End Testing
● Is more efficient through DevOps principles
● Strongly supported by automation
● Scalable environments
● Coded change and deployments
● Coded tests and failure highlighting
● Planit champions this phase
● The fork in the road. Where DevOps can be introduced
● DevOps brings more exploratory and targeted testing ability
to satisfy customer feedback
What is DevTestOps? Continue...
Creating Tests At Each Filter
Monitoring and Alerts Testing
● Issues should be detected by monitors
● Real or Mocked data can be used
● Controlled data easier to distinguish
● Rules based so standard testing practices apply
● Ensure alerts are sent and received successfully
● Ensure they are also fixable
● Ensure they detail the issue clearly
What is DevTestOps? Continue...
Creating Tests At Each Filter
Log Testing
● Records everything that is happening
● At application, Server and Cloud
level
● Errors that generate no logs
highlights issues with logging
● Reveals user behavior and hidden
issues
What is DevTestOps? Continue...
Testing in Production
● A/B Testing - Multiple versions released for
feedback
● Beta Testing - Released to a subset of users
● Feature Toggles - Change configuration in the
application
● Cannery Servers - Adjust deployment if too many
issues
● “TIP” is a hot topic on the interwebs
What is DevTestOps? Continue...
Classical Costs Still Rings True
What is DevTestOps? Continue...
Other Tests within DevOps
● Orchestration Pipeline Testing
● Code Quality Gates
● Infrastructure Configuration Testing
● Bug Bash
● Crowdsourced
● Infrastructure Resilience Testing - chaos
monkey
● Repeatable Performance and Security Tests
What is DevTestOps? Continue...
Summary
Risk Appetite
Strategic Objective
Paths To Communication
Testing Pyramid
Bug Filter
Testing In Production and Other Tests in DevOps
What is DevTestOps? Continue...
Questions?
pmateos@planittesting.com
@paulconsults
https://www.linkedin.com/in/paul-mateos-213b2167/
What is DevTestOps? Continue...
A Practical Guide To Testing in DevOps - Katrina Clokie
http://www.belatrixsf.com/blog/an-introduction-to-testing-in-production/
http://infiniteundo.com/post/158179632683/abandoning-the-pyramid-of-testing-in-favor-of-a
https://www.slideshare.net/dhelper/benefit-from-unit-testing-in-the-real-world
https://test.io/software-testing-guide/devops-best-practices-integrating-qa-devops/
References
VM and Docker Basics
● Setting up a centos VM
● Installing Docker
● Pull Jenkins Docker image and start it up
VM and Docker Basics Continue...
● Oracle Virtualbox installed
○ Developer Tools
○ Networking Tools
● Create new RedHat linux vm
● 50GB HDD, 2048MB RAM
● Networking: NAT with port forwarding
○ Host Port: 8080 Guest Port: 8080
VM and Docker Basics Continue...
● Docker CE installed
Difference between VM and Docker?
- VM’s are complete machines while
docker is a collection of libraries sharing
the host’s kernel
- There are now vSphere Containers
VM and Docker Basics Continue...
● Create Docker Container with Jenkins
Master
● Create Docker Container with Jenkins
Slave
● Use Docker compose to start up both
services

More Related Content

What's hot

DevOps Transformation: Learnings and Best Practices
DevOps Transformation: Learnings and Best PracticesDevOps Transformation: Learnings and Best Practices
DevOps Transformation: Learnings and Best Practices
QBurst
 
Accenture DevOps: Delivering applications at the pace of business
Accenture DevOps: Delivering applications at the pace of businessAccenture DevOps: Delivering applications at the pace of business
Accenture DevOps: Delivering applications at the pace of business
Accenture Technology
 
Azure DevOps
Azure DevOpsAzure DevOps
Azure DevOps
Felipe Artur Feltes
 
Intro to DevOps
Intro to DevOpsIntro to DevOps
Intro to DevOps
Ernest Mueller
 
DevOps
DevOps DevOps
DevOps
Hakan Yüksel
 
What Is DevOps?
What Is DevOps?What Is DevOps?
What Is DevOps?
Soumya De
 
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
Edureka!
 
Azure DevOps Presentation
Azure DevOps PresentationAzure DevOps Presentation
Azure DevOps Presentation
InCycleSoftware
 
Test automation proposal
Test automation proposalTest automation proposal
Test automation proposal
Mihai-Cristian Fratila
 
Azure DevOps - Azure Guatemala Meetup
Azure DevOps - Azure Guatemala MeetupAzure DevOps - Azure Guatemala Meetup
Azure DevOps - Azure Guatemala Meetup
Guillermo Zepeda Selman
 
0 to hero with Azure DevOps
0 to hero with Azure DevOps0 to hero with Azure DevOps
0 to hero with Azure DevOps
Christos Matskas
 
Getting started with Site Reliability Engineering (SRE)
Getting started with Site Reliability Engineering (SRE)Getting started with Site Reliability Engineering (SRE)
Getting started with Site Reliability Engineering (SRE)
Abeer R
 
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
Simplilearn
 
[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps
Naoki (Neo) SATO
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
Amazon Web Services
 
Azure DevOps in Action
Azure DevOps in ActionAzure DevOps in Action
Azure DevOps in Action
Callon Campbell
 
What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE? What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE?
7Targets AI Sales Assistants
 
"DevOps > CI+CD "
"DevOps > CI+CD ""DevOps > CI+CD "
"DevOps > CI+CD "
Innovation Roots
 
Welcome to Azure Devops
Welcome to Azure DevopsWelcome to Azure Devops
Welcome to Azure Devops
Alessandro Scardova
 

What's hot (20)

DevOps Transformation: Learnings and Best Practices
DevOps Transformation: Learnings and Best PracticesDevOps Transformation: Learnings and Best Practices
DevOps Transformation: Learnings and Best Practices
 
Accenture DevOps: Delivering applications at the pace of business
Accenture DevOps: Delivering applications at the pace of businessAccenture DevOps: Delivering applications at the pace of business
Accenture DevOps: Delivering applications at the pace of business
 
Azure DevOps
Azure DevOpsAzure DevOps
Azure DevOps
 
Intro to DevOps
Intro to DevOpsIntro to DevOps
Intro to DevOps
 
DevOps
DevOps DevOps
DevOps
 
What Is DevOps?
What Is DevOps?What Is DevOps?
What Is DevOps?
 
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
What is DevOps | DevOps Introduction | DevOps Training | DevOps Tutorial | Ed...
 
DevOps
DevOpsDevOps
DevOps
 
Azure DevOps Presentation
Azure DevOps PresentationAzure DevOps Presentation
Azure DevOps Presentation
 
Test automation proposal
Test automation proposalTest automation proposal
Test automation proposal
 
Azure DevOps - Azure Guatemala Meetup
Azure DevOps - Azure Guatemala MeetupAzure DevOps - Azure Guatemala Meetup
Azure DevOps - Azure Guatemala Meetup
 
0 to hero with Azure DevOps
0 to hero with Azure DevOps0 to hero with Azure DevOps
0 to hero with Azure DevOps
 
Getting started with Site Reliability Engineering (SRE)
Getting started with Site Reliability Engineering (SRE)Getting started with Site Reliability Engineering (SRE)
Getting started with Site Reliability Engineering (SRE)
 
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
DevOps Tutorial For Beginners | DevOps Tutorial | DevOps Tools | DevOps Train...
 
[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
 
Azure DevOps in Action
Azure DevOps in ActionAzure DevOps in Action
Azure DevOps in Action
 
What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE? What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE?
 
"DevOps > CI+CD "
"DevOps > CI+CD ""DevOps > CI+CD "
"DevOps > CI+CD "
 
Welcome to Azure Devops
Welcome to Azure DevopsWelcome to Azure Devops
Welcome to Azure Devops
 

Similar to DevTestOps

DevOps Primer : Presented by Uday Kumar
DevOps Primer : Presented by Uday KumarDevOps Primer : Presented by Uday Kumar
DevOps Primer : Presented by Uday Kumar
oGuild .
 
Demystifying Devops - Uday kumar
Demystifying Devops - Uday kumarDemystifying Devops - Uday kumar
Demystifying Devops - Uday kumar
Agile Testing Alliance
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?
Jean-Philippe Briend
 
DevOps for absolute beginners
DevOps for absolute beginnersDevOps for absolute beginners
DevOps for absolute beginners
Ahmed Misbah
 
Testing in DevOps world
Testing in DevOps worldTesting in DevOps world
Testing in DevOps world
Moataz Nabil
 
DevOps - Overview - One of the Top Trends in IT Industry
DevOps - Overview - One of the Top Trends in IT IndustryDevOps - Overview - One of the Top Trends in IT Industry
DevOps - Overview - One of the Top Trends in IT Industry
Rahul Tilloo
 
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps worldLucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
DevOps Enterprise Summit
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
Shalu Ahuja
 
Dev ops concept
Dev ops conceptDev ops concept
Dev ops concept
Professional Guru
 
Puppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolutionPuppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet
 
DevOps is a Journey - Choose Your Own Adventure
DevOps is a Journey - Choose Your Own AdventureDevOps is a Journey - Choose Your Own Adventure
DevOps is a Journey - Choose Your Own Adventure
Fabian Iannarella
 
Addo dev ops is journey - choose your own adventure v2
Addo   dev ops is journey - choose your own adventure v2Addo   dev ops is journey - choose your own adventure v2
Addo dev ops is journey - choose your own adventure v2
Fabian Iannarella
 
DevOps Overview in my own words
DevOps Overview in my own wordsDevOps Overview in my own words
DevOps Overview in my own words
SUBHENDU KARMAKAR
 
Understanding DevOps in simpler way with Continuous Delivery
Understanding DevOps in simpler way with Continuous DeliveryUnderstanding DevOps in simpler way with Continuous Delivery
Understanding DevOps in simpler way with Continuous Delivery
Swapnil Jain
 
Testing and DevOps Culture: Lessons Learned
Testing and DevOps Culture: Lessons LearnedTesting and DevOps Culture: Lessons Learned
Testing and DevOps Culture: Lessons LearnedLB Denker
 
Manchester ITExpo Talk: DevOps large and small - Cambridge Satchel
Manchester ITExpo Talk:  DevOps large and small - Cambridge SatchelManchester ITExpo Talk:  DevOps large and small - Cambridge Satchel
Manchester ITExpo Talk: DevOps large and small - Cambridge Satchel
Jwooldridge
 
DevOps at Lean Apps
DevOps at Lean AppsDevOps at Lean Apps
DevOps at Lean Apps
Lean Apps
 
Dev ops is a journey choose your own adventure v2
Dev ops is a journey   choose your own adventure v2Dev ops is a journey   choose your own adventure v2
Dev ops is a journey choose your own adventure v2
Fabian Iannarella
 
Agile testing
Agile testingAgile testing
Agile testing
Raj Indugula
 
Measure and Accelerate Your Software Delivery
Measure and Accelerate Your Software DeliveryMeasure and Accelerate Your Software Delivery
Measure and Accelerate Your Software Delivery
Anand Chauhan
 

Similar to DevTestOps (20)

DevOps Primer : Presented by Uday Kumar
DevOps Primer : Presented by Uday KumarDevOps Primer : Presented by Uday Kumar
DevOps Primer : Presented by Uday Kumar
 
Demystifying Devops - Uday kumar
Demystifying Devops - Uday kumarDemystifying Devops - Uday kumar
Demystifying Devops - Uday kumar
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?
 
DevOps for absolute beginners
DevOps for absolute beginnersDevOps for absolute beginners
DevOps for absolute beginners
 
Testing in DevOps world
Testing in DevOps worldTesting in DevOps world
Testing in DevOps world
 
DevOps - Overview - One of the Top Trends in IT Industry
DevOps - Overview - One of the Top Trends in IT IndustryDevOps - Overview - One of the Top Trends in IT Industry
DevOps - Overview - One of the Top Trends in IT Industry
 
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps worldLucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
Lucas Gravley - HP - Self-Healing And Monitoring in a DevOps world
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
 
Dev ops concept
Dev ops conceptDev ops concept
Dev ops concept
 
Puppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolutionPuppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolution
 
DevOps is a Journey - Choose Your Own Adventure
DevOps is a Journey - Choose Your Own AdventureDevOps is a Journey - Choose Your Own Adventure
DevOps is a Journey - Choose Your Own Adventure
 
Addo dev ops is journey - choose your own adventure v2
Addo   dev ops is journey - choose your own adventure v2Addo   dev ops is journey - choose your own adventure v2
Addo dev ops is journey - choose your own adventure v2
 
DevOps Overview in my own words
DevOps Overview in my own wordsDevOps Overview in my own words
DevOps Overview in my own words
 
Understanding DevOps in simpler way with Continuous Delivery
Understanding DevOps in simpler way with Continuous DeliveryUnderstanding DevOps in simpler way with Continuous Delivery
Understanding DevOps in simpler way with Continuous Delivery
 
Testing and DevOps Culture: Lessons Learned
Testing and DevOps Culture: Lessons LearnedTesting and DevOps Culture: Lessons Learned
Testing and DevOps Culture: Lessons Learned
 
Manchester ITExpo Talk: DevOps large and small - Cambridge Satchel
Manchester ITExpo Talk:  DevOps large and small - Cambridge SatchelManchester ITExpo Talk:  DevOps large and small - Cambridge Satchel
Manchester ITExpo Talk: DevOps large and small - Cambridge Satchel
 
DevOps at Lean Apps
DevOps at Lean AppsDevOps at Lean Apps
DevOps at Lean Apps
 
Dev ops is a journey choose your own adventure v2
Dev ops is a journey   choose your own adventure v2Dev ops is a journey   choose your own adventure v2
Dev ops is a journey choose your own adventure v2
 
Agile testing
Agile testingAgile testing
Agile testing
 
Measure and Accelerate Your Software Delivery
Measure and Accelerate Your Software DeliveryMeasure and Accelerate Your Software Delivery
Measure and Accelerate Your Software Delivery
 

Recently uploaded

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 

DevTestOps

  • 1. DevTestOps Cultural Change Through Quality Assurance Module 1 - Talk the Talk
  • 2. Module Contents What is DevOps? What is DevTestOps? Module Objectives ❏ Learn, comprehend and practice DevOps principles and fundamentals ❏ Understanding of where testing plays a part ❏ Become a competent and courageous DevOps Team member.
  • 3. Module Contents... VM Basics https://www.virtualbox.org/ https://www.centos.org/download/ Docker Basics https://store.docker.com/editions/community/docker-ce-server-centos Source Code Management https://git-scm.com/
  • 4.
  • 5. What is DevOps? The WIKI definition of DevOps DevOps is a software engineering practice that aims at unifying software development (Dev) and software operation (Ops). The main characteristic of the DevOps movement is to strongly advocate automation and monitoring at all steps of software construction, from integration, testing, releasing to deployment and infrastructure management. DevOps aims at shorter development cycles, increased deployment frequency, more dependable releases, in close alignment with business objectives
  • 6. What is DevOps? Continue... Examples of Practices?
  • 7. What is DevOps? Continue... Examples of Practices? - Law Practice - Accounting Practice - Physiotherapy Practice - Agile Practice
  • 8. What is DevOps? Continue... Examples of Practices? - DevOps Practice
  • 9. What is DevOps? Continue... The Wall of Confusion
  • 10. What is DevOps? Continue...
  • 11. What is DevOps? Continue... 6 Principles of DevOps 1. Customer Centric Action ➢ Meeting customer requirements through short feedback loops ➢ Courage to act and innovate continuously ➢ Pivot When strategy is not working ➢ Invest in products and services for customer delight
  • 12. What is DevOps? Continue... 2. Create With the End In Mind ➢ Let go of waterfall process-oriented models ➢ Act as product companies selling to real customers ➢ All members require an engineering mindset to envision and realise the product
  • 13. What is DevOps? Continue... 3. End to End Responsibility ➢ Vertically organised teams ➢ Team is responsible till end of life ➢ Full support including quality and performance
  • 14. What is DevOps? Continue... 4. Cross Functional Autonomous Teams ➢ Fully responsible ➢ T-Shaped all rounders ➢ Hotbed for growth
  • 15. What is DevOps? Continue... 5. Continuous Improvement ➢ Fail Fast ➢ Minimise waste ➢ Optimise for speed costs and ease of delivery ➢ Experimentation is paramount ➢ If it hurts do it more
  • 16. What is DevOps? Continue... 6. Automate Everything You Can ➢ Adopt CI culture with high cycle rates and instant feedback ➢ Includes infrastructure and container based cloud platforms ➢ Synonymous with drive to renew delivery methods
  • 17. What is DevOps? Continue... Key Elements of DevOps Teams ❏ Team Building
  • 18. What is DevOps? Continue... Key Elements of DevOps Teams ❏ Team Building ❏ CI and Problem Solving
  • 19. What is DevOps? Continue... Key Elements of DevOps Teams ❏ Team Building ❏ CI and Problem Solving ❏ Leadership and Feedback
  • 20. What is DevOps? Continue... Key Elements of DevOps Teams ❏ Team Building ❏ CI and Problem Solving ❏ Leadership and Feedback ❏ Courage and Experimentation
  • 21. What is DevOps? Continue... Traditional Organisation Model
  • 22. What is DevOps? Continue... DevOps Organisation Model
  • 23. What is DevOps? Continue... A Common Microservice example
  • 24. What is DevOps? Continue... Solution Architecture for DevOps
  • 25. What is DevOps? Continue... Teams Supporting a Monolithic Architecture
  • 26. What is DevOps? Continue... DevOps Supporting a Microservice Architecture
  • 27. What is DevOps? Continue... Stats from Puppet
  • 28. What is DevOps? Continue... Summary History and Definition 6 Principles of DevOps Key Elements of DevOps Teams Organisational Model Solution Architecture
  • 29. What is DevOps? Continue... Questions? pmateos@planittesting.com @paulconsults https://www.linkedin.com/in/paul-mateos-213b2167/
  • 30. What is DevOps? Continue... https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/06/23/devops-the-wall-of-confusion-un derstanding-the-basics-of-devops/ https://www.mulesoft.com/resources/api/microservices-devops-better-together https://www.devopsagileskills.org/dasa-devops-principles/ http://leanmanufacturingtools.org/77/the-seven-wastes-7-mudas/ https://www.slideshare.net/SherryChang/evolving-team-structure-in-devops https://www.slideshare.net/DevOpstastic/support-that-devops-change-agents-need http://www.planitdevops.com References
  • 31. What is DevOps? Continue... https://purplegriffon.com/quizzes/devops-mini Quiz TIme
  • 32. DevTestOps Cultural Change Through Quality Assurance Module 1 - Talk the Talk
  • 33. What is DevTestOps? DevOps with Quality Assurance as the focul point Bringing Planit’s Strengths in Agile, Automation, Engineering and Quality Assurance together Implementation of Testing practices throughout the DevOps End to End process
  • 34. What is DevTestOps? Continue... Risk Appetites - Severity / Occurrence
  • 35. What is DevTestOps? Continue... Risk Appetites - Change of Mentality
  • 36. What is DevTestOps? Continue... Strategic Objective What does the organisation want versus what they need? ● Speed To Market ● Product Quality ● Or Stability of the Production Environment
  • 37. What is DevTestOps? Continue... Paths To Communication - 5 Steps 1. Identify - Anyone who works outside of your team 2. Connect - Make connections with each individual 3. Invite - Widen the connection by bringing in new people 4. Mark - Recording the communication for future use 5. Widen - the path through activities that engage
  • 38. What is DevTestOps? Testing pyramid ● The reality is Test Automation is expensive and takes a long time to implement ● Micro service testing is quick to execute but still costly to develop ● Unit testing requires dedication, discipline and a FAITH
  • 39. What is DevTestOps? The Bug filter ● Bugs move between layers ● A good start but not complete
  • 40. What is DevTestOps? Continue... The Bug filter - Unit Sorting Smaller bugs are caught by smaller filters while larger bugs are caught by larger filters
  • 41. What is DevTestOps? Continue... The Bug filter - Unit Sorting ● Six layers to the DevOps bug filter. ● Top three are for testing that occurs in the development environment ○ unit testing ○ integration testing ○ and end-to-end testing ● Bottom three are for the information that is captured in production that can be used to detect bugs and determine product quality ○ Alerting ○ Monitoring ○ and logging
  • 42. What is DevTestOps? Continue... Creating Tests At Each Filter Unit Testing ● TDD (Test Driven Development) is a crucial foundation ● Unit test frameworks for specific code ● Mocking services to isolate integrations ● Powerful when implemented within a CI/CD pipeline and run against integration environments ● Can be difficult to implement is some circumstances ● GUI interactions ● Databases ● Legacy code ● As DevOps engineers, this is not optional
  • 43. What is DevTestOps? Continue... Creating Tests At Each Filter Integration Testing ● Runs unit tests in a complex context (component) ● Bugs can be introduced from indirect interactions with other services and applications. (System) ● Manual testing can provide great value ● Microservices is a must have architecture ● Knowledge of tools is a must for all testers ● SOUPUI ● POSTMAN ● Concept regarding NFR’s should be introduced here ● CI/CD tooling becomes essential to build, test, deploy and then test again ● Product fitness rather than code quality
  • 44. What is DevTestOps? Continue... Creating Tests At Each Filter End-to-End Testing ● Is more efficient through DevOps principles ● Strongly supported by automation ● Scalable environments ● Coded change and deployments ● Coded tests and failure highlighting ● Planit champions this phase ● The fork in the road. Where DevOps can be introduced ● DevOps brings more exploratory and targeted testing ability to satisfy customer feedback
  • 45. What is DevTestOps? Continue... Creating Tests At Each Filter Monitoring and Alerts Testing ● Issues should be detected by monitors ● Real or Mocked data can be used ● Controlled data easier to distinguish ● Rules based so standard testing practices apply ● Ensure alerts are sent and received successfully ● Ensure they are also fixable ● Ensure they detail the issue clearly
  • 46. What is DevTestOps? Continue... Creating Tests At Each Filter Log Testing ● Records everything that is happening ● At application, Server and Cloud level ● Errors that generate no logs highlights issues with logging ● Reveals user behavior and hidden issues
  • 47. What is DevTestOps? Continue... Testing in Production ● A/B Testing - Multiple versions released for feedback ● Beta Testing - Released to a subset of users ● Feature Toggles - Change configuration in the application ● Cannery Servers - Adjust deployment if too many issues ● “TIP” is a hot topic on the interwebs
  • 48. What is DevTestOps? Continue... Classical Costs Still Rings True
  • 49. What is DevTestOps? Continue... Other Tests within DevOps ● Orchestration Pipeline Testing ● Code Quality Gates ● Infrastructure Configuration Testing ● Bug Bash ● Crowdsourced ● Infrastructure Resilience Testing - chaos monkey ● Repeatable Performance and Security Tests
  • 50. What is DevTestOps? Continue... Summary Risk Appetite Strategic Objective Paths To Communication Testing Pyramid Bug Filter Testing In Production and Other Tests in DevOps
  • 51. What is DevTestOps? Continue... Questions? pmateos@planittesting.com @paulconsults https://www.linkedin.com/in/paul-mateos-213b2167/
  • 52. What is DevTestOps? Continue... A Practical Guide To Testing in DevOps - Katrina Clokie http://www.belatrixsf.com/blog/an-introduction-to-testing-in-production/ http://infiniteundo.com/post/158179632683/abandoning-the-pyramid-of-testing-in-favor-of-a https://www.slideshare.net/dhelper/benefit-from-unit-testing-in-the-real-world https://test.io/software-testing-guide/devops-best-practices-integrating-qa-devops/ References
  • 53. VM and Docker Basics ● Setting up a centos VM ● Installing Docker ● Pull Jenkins Docker image and start it up
  • 54. VM and Docker Basics Continue... ● Oracle Virtualbox installed ○ Developer Tools ○ Networking Tools ● Create new RedHat linux vm ● 50GB HDD, 2048MB RAM ● Networking: NAT with port forwarding ○ Host Port: 8080 Guest Port: 8080
  • 55. VM and Docker Basics Continue... ● Docker CE installed Difference between VM and Docker? - VM’s are complete machines while docker is a collection of libraries sharing the host’s kernel - There are now vSphere Containers
  • 56. VM and Docker Basics Continue... ● Create Docker Container with Jenkins Master ● Create Docker Container with Jenkins Slave ● Use Docker compose to start up both services