SlideShare a Scribd company logo
© Qentinel Group 2016
Safety Nets with Fast Feedback Loops
Jani Haapala 15.2.2016
© Qentinel Group 2016 PUBLIC
Measurement vs Feedback
© Qentinel Group 2016 PUBLIC
Measurement vs Feedback
Measurement:
• Weight, speed or temperature don’t tell much alone
Feedback:
• Weight + time of the day + diet = healthier life
• Speed + route planning + traffic data = arrive on time
• Temperature + time of the year + weather forecast = good
nights sleep
© Qentinel Group 2016 PUBLIC
What is measurement?
• Only one data point
• The measure of one quantity
• Normally irrelevant alone
• Input for something meaningful
• Hard to interpret or use alone
• Very prone to misinterpretations
© Qentinel Group 2016 PUBLIC
Feedback
• Refined and relevant information in selected context
(”Feedback loop”)
• Usually a sum of several measurements
• Should regulate the doing
• Provides meaningful information for the feedback follower
• Adjusts the process or system through measurements
© Qentinel Group 2016 PUBLIC
How to choose feedback?
• Should always be based on a paradigm (How the world
works? What should we be? How to make the world a
better place?)
• To get into a paradigm, one must set goals (How can I
reach my goals?)
• Those goals should be measured with feedback (Where
am I now in my journey towards my goals))
© Qentinel Group 2016 PUBLIC
Automation and speed
”Measure what you use,
use what you measure”
© Qentinel Group 2016 PUBLIC
Why increase speed with automation?
• Human evolution causes humans to think only linearly
• Digitalization causes the speed to be exponential
• Automation enables humans to keep up with this
exponential speed
• Example of exponential growth:
–Today 2 bugs, tomorrow 4 bugs, by end of the week
128 bugs!
© Qentinel Group 2016 PUBLIC
Possibilities of automation
• To create sensors for various measurements
• To gather colossal amounts of data
• To process that colossal amount of data
• To provide real time feedback
© Qentinel Group 2016 PUBLIC
Pitfalls of automation
• You have too much information
• You have too many measurements
• You gather too much data
• You measure what is easy to measure rather than
measuring what you actually need
• Defects are not corrected as soon as the warning signs
appear. (See the exponential growth example)
© Qentinel Group 2016 PUBLIC
Note!
• Measure what you use and use what you measure
• When you need to do the same task for the third time,
automate it!
• Instead of measuring the increased doing, measuring the
reduced waste is more efficient
• Reducing the waste is usually cheaper than increasing the
doing
© Qentinel Group 2016 PUBLIC
History of feedback
• Previously popular form of feedback, reporting, did always
provide outdated view of the system.
• Today’s form of feedback, dashboards, provide real time
snapshot of the system
• Future form of feedback, trends, will forecast the future of
the system
© Qentinel Group 2016 PUBLIC
Heartbeat, heartbeat, heartbeat, …
© Qentinel Group 2016 PUBLIC
Heartbeat?
• All systems have a rhythm (”heartbeat”) unique to that system
• Defines the fastest response time that the system can react to
change
• Examples for heartbeats:
– Hummingbird: n/sec
– City: 1/day
– Scrum: 1/day + 1/sprint
– Earth: 1/year
© Qentinel Group 2016 PUBLIC
Feedback and heartbeat
• Feedback is useful only when it matches the heartbeat of
the system
• Too fast or too slow feedback makes the system oscillate
until it breaks
• Feedback with a heartbeat of 1/day is irrelevant and
useless for a system with a heartbeat of 1/quarter year
• Similarly, excessively slow feedback is useless
© Qentinel Group 2016 PUBLIC
Types of feedback
• Three main types: increasing, decreasing and balancing
• In population growth, the birth rate is the increasing factor
• In price declining, the number of competitors is the
decreasing factor
• In controlling the temperature, a thermostat is the
balancing factor
© Qentinel Group 2016 PUBLIC
Note!
• System feedback dominance can change by its own
• It can be very confusing moment when the dominance
changes
• Example:
–A hot dog stand sells hot dogs and earns money. The
more they sell hot dogs, the more money they get
(increasing). At some point the oversupply drops the
price (balancing) and the profits go down.
© Qentinel Group 2016 PUBLIC
Safety nets
Unit tests
Smoke Test Set
Full Test Set
Release Tests
Release Actions
Build product
Static checks
Every commit
0 min
+ 5 min
+ 2 h
+ 1 h
+ 10 min
+ 5 min
+ 1 min
Development Environments
© Qentinel Group 2016 PUBLIC
Why have safety nets?
• Nobody makes bad decisions
• Decision interpret as bad is only the result of lacking the
relevant information
• When the responsibilities of the developers are
overloading with excessive speed in agile (DevOps), it
usually leads to unwanted defects (Dev-Ooops)
© Qentinel Group 2016 PUBLIC
DevOps?
• Mainly a trend word for Continuous Integration (CI) /
Continuous Delivery (CD)
• CI / CD should include tasks of making “pipelines”
– Pipelines should include all phases of development
– Pipelines form one complete system
– Pipelines must utilize automation
– Pipelines create safe and reliable distribution
systems
© Qentinel Group 2016 PUBLIC
Safety nets for software development
• Creates a series of fast feedback channels to software developers
• Brings visibility to stakeholders
• Utilizes the power of slowing feedback cycles
• Early bug and defect detection
• Harmonizes the processes and increases the communication
• Shows the assumptions that have been made based on
specifications (the decisions that were needed but were not
described in the specifications)
© Qentinel Group 2016 PUBLIC
Safety nets for environments
• Bears part of the teams’ responsibilities
• Helps in SecOps’ side (automatic security checks and
controlled environments)
• Enables the team to test different technologies before
taking them into use safely and in scalable manner
• Provides means of verification for the teams
• Provides environments
© Qentinel Group 2016 PUBLIC
CAQFL
• .
Model is in continuous use.
The phases of the process are automated and manual
work is minimized.
Achieving a significant improvement in quality that brings a
competitive edge.
Feedback is received right after every change.
Continuous improvement within and between each stages.
© Qentinel Group 2016 PUBLIC
CAQFL?
• Core ideology behind quality automation:
Constantly in use
Always running
Quality focused system
Focuses in relevant and meaningful information
Loops the feedback into correct places automatically
© Qentinel Group 2016 PUBLIC
Quality as a service, QaaS?
• For this we have Qentinel Pace service
• No commitment on tools that age but instead using the
state of the art open source solutions
• Focus on visualizing, producing and increasing the value
• Gathers good practises and solutions from all customers
and utilizes with all customers
• For more information, contact jani.haapala@qentinel.com or
ari.hirvonen@qentinel.com
© Qentinel Group 2016 PUBLIC
jani.haapala@qentinel.com www.qentinel.com

More Related Content

What's hot

Introduction to PE 02-05-16
Introduction to PE 02-05-16Introduction to PE 02-05-16
Introduction to PE 02-05-16
Puppet
 
Boosting your SW development with Devops
Boosting your SW development with DevopsBoosting your SW development with Devops
Boosting your SW development with DevopsTimo Stordell
 
Why to pay for independent testing, when i have an in house development team
Why to pay for independent testing, when i have an in house development teamWhy to pay for independent testing, when i have an in house development team
Why to pay for independent testing, when i have an in house development team
QATestLab
 
Bug first Zero Defect
Bug first   Zero DefectBug first   Zero Defect
Bug first Zero Defect
Oliver Schreck
 
Predictive Analytics in Software Testing
Predictive Analytics in Software TestingPredictive Analytics in Software Testing
Predictive Analytics in Software TestingPavan Kumar Kodedela
 
How to Accelerate Remote UAT
How to Accelerate Remote UATHow to Accelerate Remote UAT
How to Accelerate Remote UAT
Shiri Amit
 
Intro to PE 01/26/2016 UK
Intro to PE 01/26/2016 UKIntro to PE 01/26/2016 UK
Intro to PE 01/26/2016 UK
Puppet
 
01 on the ground oct_2014
01 on the ground oct_201401 on the ground oct_2014
01 on the ground oct_2014Victor Veloso
 
Decreasing false positives in automated testing
Decreasing false positives in automated testingDecreasing false positives in automated testing
Decreasing false positives in automated testing
Sauce Labs
 
When the System Creaks: Lessons Learned in Agile Maintenance
When the System Creaks: Lessons Learned in Agile MaintenanceWhen the System Creaks: Lessons Learned in Agile Maintenance
When the System Creaks: Lessons Learned in Agile Maintenance
TechWell
 
Black Friday Is Approaching. Are You Prepared- Infographic
Black Friday Is Approaching. Are You Prepared- InfographicBlack Friday Is Approaching. Are You Prepared- Infographic
Black Friday Is Approaching. Are You Prepared- Infographic
TestingXperts
 
Testing The User Centric Web
Testing The User Centric WebTesting The User Centric Web
Testing The User Centric Web
Matt Heusser
 
From mini waterfall to scrum
From mini waterfall to scrumFrom mini waterfall to scrum
From mini waterfall to scrum
Nick Meggoudis, PSM
 
ADDO19 - Automate or not from the beginning that is the question
ADDO19 - Automate or not from the beginning that is the questionADDO19 - Automate or not from the beginning that is the question
ADDO19 - Automate or not from the beginning that is the question
Enrique Carbonell
 
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...Scrum Bangalore
 
Test Estimation Hacks: Tips, Tricks and Tools Webinar
Test Estimation Hacks: Tips, Tricks and Tools WebinarTest Estimation Hacks: Tips, Tricks and Tools Webinar
Test Estimation Hacks: Tips, Tricks and Tools Webinar
QASymphony
 
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
Ho Chi Minh City Software Testing Club
 
Nikos chaldeos testing stories
Nikos chaldeos   testing storiesNikos chaldeos   testing stories
Nikos chaldeos testing stories
NikosChaldeos
 

What's hot (18)

Introduction to PE 02-05-16
Introduction to PE 02-05-16Introduction to PE 02-05-16
Introduction to PE 02-05-16
 
Boosting your SW development with Devops
Boosting your SW development with DevopsBoosting your SW development with Devops
Boosting your SW development with Devops
 
Why to pay for independent testing, when i have an in house development team
Why to pay for independent testing, when i have an in house development teamWhy to pay for independent testing, when i have an in house development team
Why to pay for independent testing, when i have an in house development team
 
Bug first Zero Defect
Bug first   Zero DefectBug first   Zero Defect
Bug first Zero Defect
 
Predictive Analytics in Software Testing
Predictive Analytics in Software TestingPredictive Analytics in Software Testing
Predictive Analytics in Software Testing
 
How to Accelerate Remote UAT
How to Accelerate Remote UATHow to Accelerate Remote UAT
How to Accelerate Remote UAT
 
Intro to PE 01/26/2016 UK
Intro to PE 01/26/2016 UKIntro to PE 01/26/2016 UK
Intro to PE 01/26/2016 UK
 
01 on the ground oct_2014
01 on the ground oct_201401 on the ground oct_2014
01 on the ground oct_2014
 
Decreasing false positives in automated testing
Decreasing false positives in automated testingDecreasing false positives in automated testing
Decreasing false positives in automated testing
 
When the System Creaks: Lessons Learned in Agile Maintenance
When the System Creaks: Lessons Learned in Agile MaintenanceWhen the System Creaks: Lessons Learned in Agile Maintenance
When the System Creaks: Lessons Learned in Agile Maintenance
 
Black Friday Is Approaching. Are You Prepared- Infographic
Black Friday Is Approaching. Are You Prepared- InfographicBlack Friday Is Approaching. Are You Prepared- Infographic
Black Friday Is Approaching. Are You Prepared- Infographic
 
Testing The User Centric Web
Testing The User Centric WebTesting The User Centric Web
Testing The User Centric Web
 
From mini waterfall to scrum
From mini waterfall to scrumFrom mini waterfall to scrum
From mini waterfall to scrum
 
ADDO19 - Automate or not from the beginning that is the question
ADDO19 - Automate or not from the beginning that is the questionADDO19 - Automate or not from the beginning that is the question
ADDO19 - Automate or not from the beginning that is the question
 
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
Scrum_BLR 9th meet up 28-Jun-2014 - Continuous Delivery for Fast and Consiste...
 
Test Estimation Hacks: Tips, Tricks and Tools Webinar
Test Estimation Hacks: Tips, Tricks and Tools WebinarTest Estimation Hacks: Tips, Tricks and Tools Webinar
Test Estimation Hacks: Tips, Tricks and Tools Webinar
 
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
 
Nikos chaldeos testing stories
Nikos chaldeos   testing storiesNikos chaldeos   testing stories
Nikos chaldeos testing stories
 

Viewers also liked

Rugged DevOps at Scale with Rich Mogull
Rugged DevOps at Scale with Rich MogullRugged DevOps at Scale with Rich Mogull
Rugged DevOps at Scale with Rich Mogull
SeniorStoryteller
 
Testiautomaatio ei ole tekninen ongelma - Kalle Huttunen
Testiautomaatio ei ole tekninen ongelma - Kalle HuttunenTestiautomaatio ei ole tekninen ongelma - Kalle Huttunen
Testiautomaatio ei ole tekninen ongelma - Kalle Huttunen
Qentinel
 
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollola
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollolaSosiaalisen median hyodyntaminen kunnan viestinnassa hollola
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollola
Pauliina Mäkelä
 
Strategiasta totta
Strategiasta tottaStrategiasta totta
Strategiasta totta
Ville Tolvanen
 
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
Giulio Coraggio
 
Omistaja-arvon kasvattaminen digiaikana
Omistaja-arvon kasvattaminen digiaikanaOmistaja-arvon kasvattaminen digiaikana
Omistaja-arvon kasvattaminen digiaikana
Ville Tolvanen
 
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
Katleena Kortesuo
 
Legal requirements for operating in a videolottery market
Legal requirements for operating in a videolottery marketLegal requirements for operating in a videolottery market
Legal requirements for operating in a videolottery market
Giulio Coraggio
 
Legal issues of the Internet of Things
Legal issues of the Internet of ThingsLegal issues of the Internet of Things
Legal issues of the Internet of Things
Giulio Coraggio
 

Viewers also liked (10)

Rugged DevOps at Scale with Rich Mogull
Rugged DevOps at Scale with Rich MogullRugged DevOps at Scale with Rich Mogull
Rugged DevOps at Scale with Rich Mogull
 
CFO Series #1_2
CFO Series #1_2CFO Series #1_2
CFO Series #1_2
 
Testiautomaatio ei ole tekninen ongelma - Kalle Huttunen
Testiautomaatio ei ole tekninen ongelma - Kalle HuttunenTestiautomaatio ei ole tekninen ongelma - Kalle Huttunen
Testiautomaatio ei ole tekninen ongelma - Kalle Huttunen
 
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollola
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollolaSosiaalisen median hyodyntaminen kunnan viestinnassa hollola
Sosiaalisen median hyodyntaminen kunnan viestinnassa hollola
 
Strategiasta totta
Strategiasta tottaStrategiasta totta
Strategiasta totta
 
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
Smart home e problematiche legali - L'interoperabilità tra piattaforme come u...
 
Omistaja-arvon kasvattaminen digiaikana
Omistaja-arvon kasvattaminen digiaikanaOmistaja-arvon kasvattaminen digiaikana
Omistaja-arvon kasvattaminen digiaikana
 
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
Täyttä sisältöä (sisällöntuotantokoulutus TTL:ssa)
 
Legal requirements for operating in a videolottery market
Legal requirements for operating in a videolottery marketLegal requirements for operating in a videolottery market
Legal requirements for operating in a videolottery market
 
Legal issues of the Internet of Things
Legal issues of the Internet of ThingsLegal issues of the Internet of Things
Legal issues of the Internet of Things
 

Similar to Safety nets with fast feedback loops | Jani haapala 2016-10

ALM 101: An introduction to application lifecycle management
ALM 101: An introduction to application lifecycle managementALM 101: An introduction to application lifecycle management
ALM 101: An introduction to application lifecycle management
nonlinear creations
 
Lean Tools
Lean ToolsLean Tools
Lean Tools
Abhishek Botre
 
Lean Based Sofware Development
Lean Based Sofware DevelopmentLean Based Sofware Development
Lean Based Sofware Development
Semen Arslan
 
Code vigil
Code vigilCode vigil
Code vigil
Kunal Bhat
 
Modernising Change Management with Enterprise DevOps
Modernising Change Management with Enterprise DevOpsModernising Change Management with Enterprise DevOps
Modernising Change Management with Enterprise DevOps
Puppet
 
Evidence Based Management and Organisational Change
Evidence Based Management and Organisational ChangeEvidence Based Management and Organisational Change
Evidence Based Management and Organisational Change
Simon Reindl
 
Safeabilty: Analyzing the Relationship between Safety and Reliability
Safeabilty: Analyzing the Relationship between Safety and Reliability Safeabilty: Analyzing the Relationship between Safety and Reliability
Safeabilty: Analyzing the Relationship between Safety and Reliability
PlantEngineering
 
Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1
Health Innovation West of England
 
Integrative KeynoteV2
Integrative KeynoteV2Integrative KeynoteV2
Integrative KeynoteV2Murray Cantor
 
CodeVigil
CodeVigilCodeVigil
CodeVigil
Kunal Bhat
 
Lean & Agile Value Streams
Lean & Agile Value StreamsLean & Agile Value Streams
Lean & Agile Value Streams
Maris Prabhakaran M
 
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
TechWell
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2
Edmund FOng
 
Dev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard HunterDev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard Hunter
SpotQA
 
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
ProductCamp Boston
 
Qlcl bao cao
Qlcl bao caoQlcl bao cao
Qlcl bao cao
Luong Tien Dat
 
Turbocharging your Google Analytics data
Turbocharging your Google Analytics dataTurbocharging your Google Analytics data
Turbocharging your Google Analytics data
Neil Barnes
 
Altus Alliance 2016 - How to Plan a Pain-Free Upgrade
Altus Alliance 2016 - How to Plan a Pain-Free UpgradeAltus Alliance 2016 - How to Plan a Pain-Free Upgrade
Altus Alliance 2016 - How to Plan a Pain-Free Upgrade
Sparkrock
 

Similar to Safety nets with fast feedback loops | Jani haapala 2016-10 (20)

ALM 101: An introduction to application lifecycle management
ALM 101: An introduction to application lifecycle managementALM 101: An introduction to application lifecycle management
ALM 101: An introduction to application lifecycle management
 
Lean Tools
Lean ToolsLean Tools
Lean Tools
 
Lean Based Sofware Development
Lean Based Sofware DevelopmentLean Based Sofware Development
Lean Based Sofware Development
 
Code vigil
Code vigilCode vigil
Code vigil
 
Modernising Change Management with Enterprise DevOps
Modernising Change Management with Enterprise DevOpsModernising Change Management with Enterprise DevOps
Modernising Change Management with Enterprise DevOps
 
Evidence Based Management and Organisational Change
Evidence Based Management and Organisational ChangeEvidence Based Management and Organisational Change
Evidence Based Management and Organisational Change
 
Safeabilty: Analyzing the Relationship between Safety and Reliability
Safeabilty: Analyzing the Relationship between Safety and Reliability Safeabilty: Analyzing the Relationship between Safety and Reliability
Safeabilty: Analyzing the Relationship between Safety and Reliability
 
Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1
 
Integrative KeynoteV2
Integrative KeynoteV2Integrative KeynoteV2
Integrative KeynoteV2
 
CodeVigil
CodeVigilCodeVigil
CodeVigil
 
Lean & Agile Value Streams
Lean & Agile Value StreamsLean & Agile Value Streams
Lean & Agile Value Streams
 
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
Getting the Most Value from Feedback Systems: Daily, Every Sprint, and Every ...
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2
 
Dev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard HunterDev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard Hunter
 
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
 
Qlcl bao cao
Qlcl bao caoQlcl bao cao
Qlcl bao cao
 
Turbocharging your Google Analytics data
Turbocharging your Google Analytics dataTurbocharging your Google Analytics data
Turbocharging your Google Analytics data
 
Altus Alliance 2016 - How to Plan a Pain-Free Upgrade
Altus Alliance 2016 - How to Plan a Pain-Free UpgradeAltus Alliance 2016 - How to Plan a Pain-Free Upgrade
Altus Alliance 2016 - How to Plan a Pain-Free Upgrade
 
Change control and configuration
Change control and configurationChange control and configuration
Change control and configuration
 
Change control and configuration
Change control and configurationChange control and configuration
Change control and configuration
 

More from Qentinel

Sap Finug hosted by Qentinel 12.3.2019, esitykset
Sap Finug hosted by Qentinel 12.3.2019, esityksetSap Finug hosted by Qentinel 12.3.2019, esitykset
Sap Finug hosted by Qentinel 12.3.2019, esitykset
Qentinel
 
Qentinel's garage story in Slush 2018
Qentinel's garage story in Slush 2018Qentinel's garage story in Slush 2018
Qentinel's garage story in Slush 2018
Qentinel
 
What is computer vision?
What is computer vision?What is computer vision?
What is computer vision?
Qentinel
 
SAP End-to-end liiketoimintaprosessin testaus
SAP End-to-end liiketoimintaprosessin testausSAP End-to-end liiketoimintaprosessin testaus
SAP End-to-end liiketoimintaprosessin testaus
Qentinel
 
End-to-end huoltoprosessin testaus, IFS Asiakaspäivä
End-to-end huoltoprosessin testaus, IFS AsiakaspäiväEnd-to-end huoltoprosessin testaus, IFS Asiakaspäivä
End-to-end huoltoprosessin testaus, IFS Asiakaspäivä
Qentinel
 
Women in Tech - tukiäly asiakaskokemuksen kumppanina
Women in Tech - tukiäly asiakaskokemuksen kumppaninaWomen in Tech - tukiäly asiakaskokemuksen kumppanina
Women in Tech - tukiäly asiakaskokemuksen kumppanina
Qentinel
 
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
Qentinel
 
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
Qentinel
 
Menesty ekosysteemissä -webinaari 14.11.2017
Menesty ekosysteemissä -webinaari 14.11.2017Menesty ekosysteemissä -webinaari 14.11.2017
Menesty ekosysteemissä -webinaari 14.11.2017
Qentinel
 
Infrastructure As a Code (IAC) Jani Haapala 2017
Infrastructure As a Code (IAC) Jani Haapala 2017Infrastructure As a Code (IAC) Jani Haapala 2017
Infrastructure As a Code (IAC) Jani Haapala 2017
Qentinel
 
GDPR and test data challenge Antti Heimola 20170504
GDPR and test data challenge Antti Heimola 20170504GDPR and test data challenge Antti Heimola 20170504
GDPR and test data challenge Antti Heimola 20170504
Qentinel
 
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
Qentinel
 
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
Qentinel
 
Etumatkan kolme-taitoa-esko-hannula-20170216
Etumatkan kolme-taitoa-esko-hannula-20170216Etumatkan kolme-taitoa-esko-hannula-20170216
Etumatkan kolme-taitoa-esko-hannula-20170216
Qentinel
 
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
Qentinel
 
End-to-end testaus eri päätelaitteilla - Antti Heimola
End-to-end testaus eri päätelaitteilla - Antti HeimolaEnd-to-end testaus eri päätelaitteilla - Antti Heimola
End-to-end testaus eri päätelaitteilla - Antti Heimola
Qentinel
 
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
Qentinel
 
CI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
CI Security Scan - Teemu Vesalan esitys 7.6. TestiautomaatioklinkassaCI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
CI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
Qentinel
 
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
Qentinel
 
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
Qentinel
 

More from Qentinel (20)

Sap Finug hosted by Qentinel 12.3.2019, esitykset
Sap Finug hosted by Qentinel 12.3.2019, esityksetSap Finug hosted by Qentinel 12.3.2019, esitykset
Sap Finug hosted by Qentinel 12.3.2019, esitykset
 
Qentinel's garage story in Slush 2018
Qentinel's garage story in Slush 2018Qentinel's garage story in Slush 2018
Qentinel's garage story in Slush 2018
 
What is computer vision?
What is computer vision?What is computer vision?
What is computer vision?
 
SAP End-to-end liiketoimintaprosessin testaus
SAP End-to-end liiketoimintaprosessin testausSAP End-to-end liiketoimintaprosessin testaus
SAP End-to-end liiketoimintaprosessin testaus
 
End-to-end huoltoprosessin testaus, IFS Asiakaspäivä
End-to-end huoltoprosessin testaus, IFS AsiakaspäiväEnd-to-end huoltoprosessin testaus, IFS Asiakaspäivä
End-to-end huoltoprosessin testaus, IFS Asiakaspäivä
 
Women in Tech - tukiäly asiakaskokemuksen kumppanina
Women in Tech - tukiäly asiakaskokemuksen kumppaninaWomen in Tech - tukiäly asiakaskokemuksen kumppanina
Women in Tech - tukiäly asiakaskokemuksen kumppanina
 
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
Writing Readable Test Automation - Qentinel Automation Clinic 1.3.2018
 
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
Ecosystem Automation as a Service - Qentinel Automation Clinic 1.3.2018
 
Menesty ekosysteemissä -webinaari 14.11.2017
Menesty ekosysteemissä -webinaari 14.11.2017Menesty ekosysteemissä -webinaari 14.11.2017
Menesty ekosysteemissä -webinaari 14.11.2017
 
Infrastructure As a Code (IAC) Jani Haapala 2017
Infrastructure As a Code (IAC) Jani Haapala 2017Infrastructure As a Code (IAC) Jani Haapala 2017
Infrastructure As a Code (IAC) Jani Haapala 2017
 
GDPR and test data challenge Antti Heimola 20170504
GDPR and test data challenge Antti Heimola 20170504GDPR and test data challenge Antti Heimola 20170504
GDPR and test data challenge Antti Heimola 20170504
 
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
Asiakaskokemus ekosysteemissä-qentinel-2017-04-27
 
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
Kilpailuetua muutoksessa –webinaari. Miten johdan epävarmuuksilla?
 
Etumatkan kolme-taitoa-esko-hannula-20170216
Etumatkan kolme-taitoa-esko-hannula-20170216Etumatkan kolme-taitoa-esko-hannula-20170216
Etumatkan kolme-taitoa-esko-hannula-20170216
 
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
Asiakaskokemus tulevaisuudessa -webinaari Qentinel 10.1.2017
 
End-to-end testaus eri päätelaitteilla - Antti Heimola
End-to-end testaus eri päätelaitteilla - Antti HeimolaEnd-to-end testaus eri päätelaitteilla - Antti Heimola
End-to-end testaus eri päätelaitteilla - Antti Heimola
 
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
Jos sinulla olisi kaikki tieto - tietäisitkö kaiken? Esko Hannulan esitys 8.9...
 
CI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
CI Security Scan - Teemu Vesalan esitys 7.6. TestiautomaatioklinkassaCI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
CI Security Scan - Teemu Vesalan esitys 7.6. Testiautomaatioklinkassa
 
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
Testiautomaatio ja Key word driven -ajattelutapa - Kalle Huttusen esitys 7.6.
 
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
Jani Haapalan esitys Wakarun Prosessipäivillä 19.4.2016
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 

Safety nets with fast feedback loops | Jani haapala 2016-10

  • 1. © Qentinel Group 2016 Safety Nets with Fast Feedback Loops Jani Haapala 15.2.2016
  • 2. © Qentinel Group 2016 PUBLIC Measurement vs Feedback
  • 3. © Qentinel Group 2016 PUBLIC Measurement vs Feedback Measurement: • Weight, speed or temperature don’t tell much alone Feedback: • Weight + time of the day + diet = healthier life • Speed + route planning + traffic data = arrive on time • Temperature + time of the year + weather forecast = good nights sleep
  • 4. © Qentinel Group 2016 PUBLIC What is measurement? • Only one data point • The measure of one quantity • Normally irrelevant alone • Input for something meaningful • Hard to interpret or use alone • Very prone to misinterpretations
  • 5. © Qentinel Group 2016 PUBLIC Feedback • Refined and relevant information in selected context (”Feedback loop”) • Usually a sum of several measurements • Should regulate the doing • Provides meaningful information for the feedback follower • Adjusts the process or system through measurements
  • 6. © Qentinel Group 2016 PUBLIC How to choose feedback? • Should always be based on a paradigm (How the world works? What should we be? How to make the world a better place?) • To get into a paradigm, one must set goals (How can I reach my goals?) • Those goals should be measured with feedback (Where am I now in my journey towards my goals))
  • 7. © Qentinel Group 2016 PUBLIC Automation and speed ”Measure what you use, use what you measure”
  • 8. © Qentinel Group 2016 PUBLIC Why increase speed with automation? • Human evolution causes humans to think only linearly • Digitalization causes the speed to be exponential • Automation enables humans to keep up with this exponential speed • Example of exponential growth: –Today 2 bugs, tomorrow 4 bugs, by end of the week 128 bugs!
  • 9. © Qentinel Group 2016 PUBLIC Possibilities of automation • To create sensors for various measurements • To gather colossal amounts of data • To process that colossal amount of data • To provide real time feedback
  • 10. © Qentinel Group 2016 PUBLIC Pitfalls of automation • You have too much information • You have too many measurements • You gather too much data • You measure what is easy to measure rather than measuring what you actually need • Defects are not corrected as soon as the warning signs appear. (See the exponential growth example)
  • 11. © Qentinel Group 2016 PUBLIC Note! • Measure what you use and use what you measure • When you need to do the same task for the third time, automate it! • Instead of measuring the increased doing, measuring the reduced waste is more efficient • Reducing the waste is usually cheaper than increasing the doing
  • 12. © Qentinel Group 2016 PUBLIC History of feedback • Previously popular form of feedback, reporting, did always provide outdated view of the system. • Today’s form of feedback, dashboards, provide real time snapshot of the system • Future form of feedback, trends, will forecast the future of the system
  • 13. © Qentinel Group 2016 PUBLIC Heartbeat, heartbeat, heartbeat, …
  • 14. © Qentinel Group 2016 PUBLIC Heartbeat? • All systems have a rhythm (”heartbeat”) unique to that system • Defines the fastest response time that the system can react to change • Examples for heartbeats: – Hummingbird: n/sec – City: 1/day – Scrum: 1/day + 1/sprint – Earth: 1/year
  • 15. © Qentinel Group 2016 PUBLIC Feedback and heartbeat • Feedback is useful only when it matches the heartbeat of the system • Too fast or too slow feedback makes the system oscillate until it breaks • Feedback with a heartbeat of 1/day is irrelevant and useless for a system with a heartbeat of 1/quarter year • Similarly, excessively slow feedback is useless
  • 16. © Qentinel Group 2016 PUBLIC Types of feedback • Three main types: increasing, decreasing and balancing • In population growth, the birth rate is the increasing factor • In price declining, the number of competitors is the decreasing factor • In controlling the temperature, a thermostat is the balancing factor
  • 17. © Qentinel Group 2016 PUBLIC Note! • System feedback dominance can change by its own • It can be very confusing moment when the dominance changes • Example: –A hot dog stand sells hot dogs and earns money. The more they sell hot dogs, the more money they get (increasing). At some point the oversupply drops the price (balancing) and the profits go down.
  • 18. © Qentinel Group 2016 PUBLIC Safety nets Unit tests Smoke Test Set Full Test Set Release Tests Release Actions Build product Static checks Every commit 0 min + 5 min + 2 h + 1 h + 10 min + 5 min + 1 min Development Environments
  • 19. © Qentinel Group 2016 PUBLIC Why have safety nets? • Nobody makes bad decisions • Decision interpret as bad is only the result of lacking the relevant information • When the responsibilities of the developers are overloading with excessive speed in agile (DevOps), it usually leads to unwanted defects (Dev-Ooops)
  • 20. © Qentinel Group 2016 PUBLIC DevOps? • Mainly a trend word for Continuous Integration (CI) / Continuous Delivery (CD) • CI / CD should include tasks of making “pipelines” – Pipelines should include all phases of development – Pipelines form one complete system – Pipelines must utilize automation – Pipelines create safe and reliable distribution systems
  • 21. © Qentinel Group 2016 PUBLIC Safety nets for software development • Creates a series of fast feedback channels to software developers • Brings visibility to stakeholders • Utilizes the power of slowing feedback cycles • Early bug and defect detection • Harmonizes the processes and increases the communication • Shows the assumptions that have been made based on specifications (the decisions that were needed but were not described in the specifications)
  • 22. © Qentinel Group 2016 PUBLIC Safety nets for environments • Bears part of the teams’ responsibilities • Helps in SecOps’ side (automatic security checks and controlled environments) • Enables the team to test different technologies before taking them into use safely and in scalable manner • Provides means of verification for the teams • Provides environments
  • 23. © Qentinel Group 2016 PUBLIC CAQFL • . Model is in continuous use. The phases of the process are automated and manual work is minimized. Achieving a significant improvement in quality that brings a competitive edge. Feedback is received right after every change. Continuous improvement within and between each stages.
  • 24. © Qentinel Group 2016 PUBLIC CAQFL? • Core ideology behind quality automation: Constantly in use Always running Quality focused system Focuses in relevant and meaningful information Loops the feedback into correct places automatically
  • 25. © Qentinel Group 2016 PUBLIC Quality as a service, QaaS? • For this we have Qentinel Pace service • No commitment on tools that age but instead using the state of the art open source solutions • Focus on visualizing, producing and increasing the value • Gathers good practises and solutions from all customers and utilizes with all customers • For more information, contact jani.haapala@qentinel.com or ari.hirvonen@qentinel.com
  • 26. © Qentinel Group 2016 PUBLIC jani.haapala@qentinel.com www.qentinel.com