SlideShare a Scribd company logo
Real-Time Quality
(RTQ)
Tathagat Varma
http://thoughtleadership.in
The complexity is increasing…
Devices continue to grow…
And so does the cloud…
…and will only get “10X’ed”!!!
Welcome to the future…!
Big questions…
What is the meaning of “quality” in this
world?
How does the scale and pace impact
quality?
What are the directions ahead?
From Traditional to Agile…
Known
Requirements
Stable
Technology
Static Business
Models
Dynamic
Requirements
Ever-changing
Technology
Evolving
Business
Models
Old World New World
Quality = conformance Quality = capabilities
The big shift in Quality…
1960s: Waterfall Model
1970s: Software Engineering
1980s: Spiral Model, RAD, SSAD, IID
1990s: Big Process Movement (CMM, ISO, 6 Sigma), V-model
2000s: Agile, XP, Scrum, Lean, Kanban, CI, TDD, ATDD, BDD
2010s: CD, Web Performance, Lean Startups, Business Model, Design
Thinking, Customer Development, A/B Testing
Now: App Performance, Data Quality, Prediction Quality, DevOps,
DevSecOps, NoOps…
Near future: ML/AI Quality, IOT, …
Business is The New Quality!
Software
(test the
code)
Product
(test against
specs)
Service
(test for
SLAs)
Business
(just get the
$$$)
Infrastructure Quality
Multiple Daily Builds: 3X up!
https://blog.newrelic.com/2016/02/04/data-culture-survey-results-faster-deployment/
High performers are killing it!
…and the metrics are showing!
Apollo - Amazon’s Deployment Engine
Autonomous teams own their service, and
directly interact with customers
Apollo was created to reliably deploy code
at Amazon scale
(2014) In past 12months, Apollo was used
for 50M deployments. That one per
second!
Data Quality
Complete, Valid, Consistent, Timely, Accurate
(2002) Cost of poor data quality (US): $600B
(2009) Average company loses $8m due to poor
data quality, as per Gartner
(2014) Average company loses 12% revenue due
to bad data
The challenge is to assure high data quality…
Learning Quality
An estimated 30% of Amazon’s revenue
comes from recommendation engines!
Worldwide average is 12%
60% of clicks on YouTube homepage due to
recommended videos!
With big data, how do you ensure high
learning and prediction quality…in real
time?
Examples…
Is this picture offensive or not?
Is this a spam mail or not?
Is “Big Ben” a monument, a movie or a book?
Whom to target for the next fashion product?
Should you offer discount to this shopper?
Is this the right recommendation for you?
Remember TAY :)
…
So, what’s Real Time Quality?
The ability of an org to respond in real-
time to a crisis or an opportunity
by offering high-quality product,
feature, fix, service, recommendation,
etc…
using high-quality data and machine
learning and prediction models
Real-Time Quality
Infra Data
Learn
Recap
IT Deployment is getting (near) real time, and
increasingly available off-the-shelf!
Business decisions are getting (near) real time, and
expect IT to support it.
The notion of quality needs to support this scenario with
increased capabilities
Quality will increasingly mean quality of data, quality
of learning, quality of recommendation, quality of
decisions, etc.…all made in real time!
This is Real Time Quality!
References
Google runs on 5000 times more code than the original space shuttle, https://www.weforum.org/agenda/
2016/07/google-runs-on-5000-times-more-code-than-the-original-space-shuttle
Codebases - Millions of lines of code, http://www.informationisbeautiful.net/visualizations/million-
lines-of-code/
The Internet of Things Explained, http://www.i-scoop.eu/internet-of-things/
Deploying at GitHub, https://github.com/blog/1241-deploying-at-github
https://www.quora.com/How-do-big-companies-like-Facebook-Google-manage-software-releases-
without-causing-system-outages-and-poor-user-experience
http://www.allthingsdistributed.com/2014/11/apollo-amazon-deployment-engine.html
https://www.quora.com/What-is-Amazon-Apollo
DevOps 2016 Report
https://astheqaworldturns.wordpress.com/2011/03/03/the-evolution-of-software-qa/
http://www.hugeinc.com/ideas/perspective/evolving-qa
http://www.testingexcellence.com/evolution-software-quality-assurance-test-engineering/
https://econsultancy.com/blog/64612-the-cost-of-bad-data-stats/

More Related Content

What's hot

Hadoop innovation index
Hadoop innovation indexHadoop innovation index
Hadoop innovation index
WeAreInnovation
 
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner AccentureFinancial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
Vin Malhotra
 
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
Vin Malhotra
 
HLEG thematic workshop on measuring economic, social and environmental resili...
HLEG thematic workshop on measuring economic, social and environmental resili...HLEG thematic workshop on measuring economic, social and environmental resili...
HLEG thematic workshop on measuring economic, social and environmental resili...
StatsCommunications
 
Big Data & Analytics Trends 2016 Vin Malhotra
Big Data & Analytics Trends 2016 Vin MalhotraBig Data & Analytics Trends 2016 Vin Malhotra
Big Data & Analytics Trends 2016 Vin Malhotra
Vin Malhotra
 
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
Techsylvania
 
Artificial Intelligence: what value for intelligent machines?
Artificial Intelligence: what value for intelligent machines?Artificial Intelligence: what value for intelligent machines?
Artificial Intelligence: what value for intelligent machines?
WeAreInnovation
 
Building for the future of AI and Machine Learning at scale
Building for the future of AI and Machine Learning at scaleBuilding for the future of AI and Machine Learning at scale
Building for the future of AI and Machine Learning at scale
Michael Nealey
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
Crowdsourcing Week
 
Analytics Service Framework
Analytics Service Framework Analytics Service Framework
Analytics Service Framework
Vishwanath Ramdas
 
Cognizant Making AI Real with Microsoft
Cognizant Making AI Real with MicrosoftCognizant Making AI Real with Microsoft
Cognizant Making AI Real with Microsoft
Steve Lennon
 
The State of Mobile Apps 2012: A Survey of Enterprise Plans
The State of Mobile Apps 2012: A Survey of Enterprise Plans The State of Mobile Apps 2012: A Survey of Enterprise Plans
The State of Mobile Apps 2012: A Survey of Enterprise Plans
Kony, Inc.
 
Digital marketing a quick run through
Digital marketing a quick run throughDigital marketing a quick run through
Digital marketing a quick run through
Mark Hayward
 
Digitalization in Singapore - Policy Discussion at National University of Sin...
Digitalization in Singapore - Policy Discussion at National University of Sin...Digitalization in Singapore - Policy Discussion at National University of Sin...
Digitalization in Singapore - Policy Discussion at National University of Sin...
Victor Tay
 
Pwc data analytics
Pwc data analyticsPwc data analytics
Pwc data analytics
Pip Barton
 
What is Digital Disruption?
What is Digital Disruption?What is Digital Disruption?
What is Digital Disruption?
Chuck Elias
 
Do end-users fit the informatics requirements?
Do end-users fit the informatics requirements?Do end-users fit the informatics requirements?
Do end-users fit the informatics requirements?
John Trigg
 
Do Accelerators And Incubators Serve Themselves Better Than Startups?
Do Accelerators And Incubators Serve Themselves Better Than Startups?Do Accelerators And Incubators Serve Themselves Better Than Startups?
Do Accelerators And Incubators Serve Themselves Better Than Startups?
Faisal Hoque
 
Norris Clark PM Cluster SFO 2009
Norris Clark PM Cluster SFO 2009Norris Clark PM Cluster SFO 2009
Norris Clark PM Cluster SFO 2009
Prediction Markets Clusters
 

What's hot (19)

Hadoop innovation index
Hadoop innovation indexHadoop innovation index
Hadoop innovation index
 
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner AccentureFinancial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
Financial Technology Gartner Summit Briefing - Vin Malhotra, Partner Accenture
 
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
Technolony Vision 2016 - Primacy Of People First In A Digital World - Vin Mal...
 
HLEG thematic workshop on measuring economic, social and environmental resili...
HLEG thematic workshop on measuring economic, social and environmental resili...HLEG thematic workshop on measuring economic, social and environmental resili...
HLEG thematic workshop on measuring economic, social and environmental resili...
 
Big Data & Analytics Trends 2016 Vin Malhotra
Big Data & Analytics Trends 2016 Vin MalhotraBig Data & Analytics Trends 2016 Vin Malhotra
Big Data & Analytics Trends 2016 Vin Malhotra
 
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
Simon McDougall, Regional Leader EEMA, McKinsey – How Should Startups Engage ...
 
Artificial Intelligence: what value for intelligent machines?
Artificial Intelligence: what value for intelligent machines?Artificial Intelligence: what value for intelligent machines?
Artificial Intelligence: what value for intelligent machines?
 
Building for the future of AI and Machine Learning at scale
Building for the future of AI and Machine Learning at scaleBuilding for the future of AI and Machine Learning at scale
Building for the future of AI and Machine Learning at scale
 
Human Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovationHuman Collective Intelligence: the future of corporate innovation
Human Collective Intelligence: the future of corporate innovation
 
Analytics Service Framework
Analytics Service Framework Analytics Service Framework
Analytics Service Framework
 
Cognizant Making AI Real with Microsoft
Cognizant Making AI Real with MicrosoftCognizant Making AI Real with Microsoft
Cognizant Making AI Real with Microsoft
 
The State of Mobile Apps 2012: A Survey of Enterprise Plans
The State of Mobile Apps 2012: A Survey of Enterprise Plans The State of Mobile Apps 2012: A Survey of Enterprise Plans
The State of Mobile Apps 2012: A Survey of Enterprise Plans
 
Digital marketing a quick run through
Digital marketing a quick run throughDigital marketing a quick run through
Digital marketing a quick run through
 
Digitalization in Singapore - Policy Discussion at National University of Sin...
Digitalization in Singapore - Policy Discussion at National University of Sin...Digitalization in Singapore - Policy Discussion at National University of Sin...
Digitalization in Singapore - Policy Discussion at National University of Sin...
 
Pwc data analytics
Pwc data analyticsPwc data analytics
Pwc data analytics
 
What is Digital Disruption?
What is Digital Disruption?What is Digital Disruption?
What is Digital Disruption?
 
Do end-users fit the informatics requirements?
Do end-users fit the informatics requirements?Do end-users fit the informatics requirements?
Do end-users fit the informatics requirements?
 
Do Accelerators And Incubators Serve Themselves Better Than Startups?
Do Accelerators And Incubators Serve Themselves Better Than Startups?Do Accelerators And Incubators Serve Themselves Better Than Startups?
Do Accelerators And Incubators Serve Themselves Better Than Startups?
 
Norris Clark PM Cluster SFO 2009
Norris Clark PM Cluster SFO 2009Norris Clark PM Cluster SFO 2009
Norris Clark PM Cluster SFO 2009
 

Viewers also liked

Team Games For Agility & Innovation
Team Games For Agility & InnovationTeam Games For Agility & Innovation
Team Games For Agility & Innovation
Tathagat Varma
 
Design Thinking
Design Thinking  Design Thinking
Design Thinking
Tathagat Varma
 
Demystifying DevOps
Demystifying DevOpsDemystifying DevOps
Demystifying DevOps
Tathagat Varma
 
Towards Agile Organisations
Towards Agile OrganisationsTowards Agile Organisations
Towards Agile Organisations
Tathagat Varma
 
Agile Innovation
Agile InnovationAgile Innovation
Agile Innovation
Tathagat Varma
 
Could aggregation of "marginal gains" lead to innovation?
Could aggregation of "marginal gains" lead to innovation?Could aggregation of "marginal gains" lead to innovation?
Could aggregation of "marginal gains" lead to innovation?
Tathagat Varma
 
Identifying Product Market Fit
Identifying Product Market FitIdentifying Product Market Fit
Identifying Product Market Fit
Tathagat Varma
 
Innovation Games Workshop
Innovation Games WorkshopInnovation Games Workshop
Innovation Games Workshop
Tathagat Varma
 
Software Project Excellence
Software Project ExcellenceSoftware Project Excellence
Software Project Excellence
Tathagat Varma
 
Agile Leadership
Agile LeadershipAgile Leadership
Agile Leadership
Tathagat Varma
 
Managing Complexity
Managing ComplexityManaging Complexity
Managing Complexity
Tathagat Varma
 
Lean Startup in the Enterprise
Lean Startup in the EnterpriseLean Startup in the Enterprise
Lean Startup in the Enterprise
Tathagat Varma
 
Lecture 9: Creative Industries
Lecture 9: Creative IndustriesLecture 9: Creative Industries
Lecture 9: Creative Industries
Tathagat Varma
 
Lecture 8: Creative Organizations
Lecture 8: Creative OrganizationsLecture 8: Creative Organizations
Lecture 8: Creative Organizations
Tathagat Varma
 
Lecture 10: Creative Spaces
Lecture 10: Creative SpacesLecture 10: Creative Spaces
Lecture 10: Creative Spaces
Tathagat Varma
 
Get Job ready...
Get Job ready...Get Job ready...
Get Job ready...
Tathagat Varma
 
Is Nature Agile?
Is Nature Agile?Is Nature Agile?
Is Nature Agile?
Tathagat Varma
 
Lecture 6: Creative Collaboration
Lecture 6: Creative CollaborationLecture 6: Creative Collaboration
Lecture 6: Creative Collaboration
Tathagat Varma
 
An Overview of SAFe
An Overview of SAFeAn Overview of SAFe
An Overview of SAFe
Tathagat Varma
 
Chapter 7: Creative Leadership
Chapter 7:  Creative LeadershipChapter 7:  Creative Leadership
Chapter 7: Creative Leadership
Tathagat Varma
 

Viewers also liked (20)

Team Games For Agility & Innovation
Team Games For Agility & InnovationTeam Games For Agility & Innovation
Team Games For Agility & Innovation
 
Design Thinking
Design Thinking  Design Thinking
Design Thinking
 
Demystifying DevOps
Demystifying DevOpsDemystifying DevOps
Demystifying DevOps
 
Towards Agile Organisations
Towards Agile OrganisationsTowards Agile Organisations
Towards Agile Organisations
 
Agile Innovation
Agile InnovationAgile Innovation
Agile Innovation
 
Could aggregation of "marginal gains" lead to innovation?
Could aggregation of "marginal gains" lead to innovation?Could aggregation of "marginal gains" lead to innovation?
Could aggregation of "marginal gains" lead to innovation?
 
Identifying Product Market Fit
Identifying Product Market FitIdentifying Product Market Fit
Identifying Product Market Fit
 
Innovation Games Workshop
Innovation Games WorkshopInnovation Games Workshop
Innovation Games Workshop
 
Software Project Excellence
Software Project ExcellenceSoftware Project Excellence
Software Project Excellence
 
Agile Leadership
Agile LeadershipAgile Leadership
Agile Leadership
 
Managing Complexity
Managing ComplexityManaging Complexity
Managing Complexity
 
Lean Startup in the Enterprise
Lean Startup in the EnterpriseLean Startup in the Enterprise
Lean Startup in the Enterprise
 
Lecture 9: Creative Industries
Lecture 9: Creative IndustriesLecture 9: Creative Industries
Lecture 9: Creative Industries
 
Lecture 8: Creative Organizations
Lecture 8: Creative OrganizationsLecture 8: Creative Organizations
Lecture 8: Creative Organizations
 
Lecture 10: Creative Spaces
Lecture 10: Creative SpacesLecture 10: Creative Spaces
Lecture 10: Creative Spaces
 
Get Job ready...
Get Job ready...Get Job ready...
Get Job ready...
 
Is Nature Agile?
Is Nature Agile?Is Nature Agile?
Is Nature Agile?
 
Lecture 6: Creative Collaboration
Lecture 6: Creative CollaborationLecture 6: Creative Collaboration
Lecture 6: Creative Collaboration
 
An Overview of SAFe
An Overview of SAFeAn Overview of SAFe
An Overview of SAFe
 
Chapter 7: Creative Leadership
Chapter 7:  Creative LeadershipChapter 7:  Creative Leadership
Chapter 7: Creative Leadership
 

Similar to Real Time Quality

The Future of AI in Digital Marketing Transforming Customer Experiences.pdf
The Future of AI in Digital Marketing Transforming Customer Experiences.pdfThe Future of AI in Digital Marketing Transforming Customer Experiences.pdf
The Future of AI in Digital Marketing Transforming Customer Experiences.pdf
Adsy
 
IoT as a metaphor!
IoT as a metaphor!IoT as a metaphor!
IoT as a metaphor!
PG Madhavan
 
The Sky’s the Limit – The Rise of Machine Learnin
The Sky’s the Limit – The Rise of Machine LearninThe Sky’s the Limit – The Rise of Machine Learnin
The Sky’s the Limit – The Rise of Machine Learnin
Inside Analysis
 
Qualtrics Panel Management Product Tour: The Future of Market Research
Qualtrics Panel Management Product Tour: The Future of Market ResearchQualtrics Panel Management Product Tour: The Future of Market Research
Qualtrics Panel Management Product Tour: The Future of Market Research
Qualtrics
 
Future of data science as a profession
Future of data science as a professionFuture of data science as a profession
Future of data science as a profession
Jose Quesada
 
0 raj ngo ppt seminar.pdfx
0 raj ngo ppt seminar.pdfx0 raj ngo ppt seminar.pdfx
0 raj ngo ppt seminar.pdfx
SALMAN SHAIKH
 
Salesforce Einstein: Use Cases and Product Features
Salesforce Einstein: Use Cases and Product FeaturesSalesforce Einstein: Use Cases and Product Features
Salesforce Einstein: Use Cases and Product Features
New Delhi Salesforce Developer Group
 
Microsoft Digital Advisory Services
Microsoft Digital Advisory ServicesMicrosoft Digital Advisory Services
Microsoft Digital Advisory Services
Maria Fonsell
 
Data & AI Master Class - Jan Klawer, Artefact
Data & AI Master Class - Jan Klawer, ArtefactData & AI Master Class - Jan Klawer, Artefact
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
Dynatrace
 
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance DataDigital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
Dynatrace
 
Designing Outcomes For Usability Nycupa Hurst Final
Designing Outcomes For Usability Nycupa Hurst FinalDesigning Outcomes For Usability Nycupa Hurst Final
Designing Outcomes For Usability Nycupa Hurst Final
WIKOLO
 
Start by Understanding the Problem, Not by Delivering the Answer
Start by Understanding the Problem, Not by Delivering the AnswerStart by Understanding the Problem, Not by Delivering the Answer
Start by Understanding the Problem, Not by Delivering the Answer
FITC
 
Artificial Intelligence for Product Managers by former Yahoo! PM
Artificial Intelligence for Product Managers by former Yahoo! PMArtificial Intelligence for Product Managers by former Yahoo! PM
Artificial Intelligence for Product Managers by former Yahoo! PM
Product School
 
Future of HR Technology
Future of HR TechnologyFuture of HR Technology
Future of HR Technology
Tincup & Co.
 
SSE 2017 10-09
SSE 2017 10-09SSE 2017 10-09
SSE 2017 10-09
Galina Shubina
 
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power SessionGrowth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
Growth Tribe
 
How to Measure Important Data by fmr Booking.com Product Owner
How to Measure Important Data by fmr Booking.com Product OwnerHow to Measure Important Data by fmr Booking.com Product Owner
How to Measure Important Data by fmr Booking.com Product Owner
Product School
 
Fintech 2017 Edinburgh (Day 1)
Fintech 2017 Edinburgh (Day 1)Fintech 2017 Edinburgh (Day 1)
Fintech 2017 Edinburgh (Day 1)
Ray Bugg
 
Digital disruption
Digital disruptionDigital disruption
Digital disruption
Jerry Tan
 

Similar to Real Time Quality (20)

The Future of AI in Digital Marketing Transforming Customer Experiences.pdf
The Future of AI in Digital Marketing Transforming Customer Experiences.pdfThe Future of AI in Digital Marketing Transforming Customer Experiences.pdf
The Future of AI in Digital Marketing Transforming Customer Experiences.pdf
 
IoT as a metaphor!
IoT as a metaphor!IoT as a metaphor!
IoT as a metaphor!
 
The Sky’s the Limit – The Rise of Machine Learnin
The Sky’s the Limit – The Rise of Machine LearninThe Sky’s the Limit – The Rise of Machine Learnin
The Sky’s the Limit – The Rise of Machine Learnin
 
Qualtrics Panel Management Product Tour: The Future of Market Research
Qualtrics Panel Management Product Tour: The Future of Market ResearchQualtrics Panel Management Product Tour: The Future of Market Research
Qualtrics Panel Management Product Tour: The Future of Market Research
 
Future of data science as a profession
Future of data science as a professionFuture of data science as a profession
Future of data science as a profession
 
0 raj ngo ppt seminar.pdfx
0 raj ngo ppt seminar.pdfx0 raj ngo ppt seminar.pdfx
0 raj ngo ppt seminar.pdfx
 
Salesforce Einstein: Use Cases and Product Features
Salesforce Einstein: Use Cases and Product FeaturesSalesforce Einstein: Use Cases and Product Features
Salesforce Einstein: Use Cases and Product Features
 
Microsoft Digital Advisory Services
Microsoft Digital Advisory ServicesMicrosoft Digital Advisory Services
Microsoft Digital Advisory Services
 
Data & AI Master Class - Jan Klawer, Artefact
Data & AI Master Class - Jan Klawer, ArtefactData & AI Master Class - Jan Klawer, Artefact
Data & AI Master Class - Jan Klawer, Artefact
 
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
Managing Unrealistic User Expectations (i.e Digital for Spoilt Brats)
 
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance DataDigital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
Digital Disruption Asia - Pleasing the Unpleasable with Digital Performance Data
 
Designing Outcomes For Usability Nycupa Hurst Final
Designing Outcomes For Usability Nycupa Hurst FinalDesigning Outcomes For Usability Nycupa Hurst Final
Designing Outcomes For Usability Nycupa Hurst Final
 
Start by Understanding the Problem, Not by Delivering the Answer
Start by Understanding the Problem, Not by Delivering the AnswerStart by Understanding the Problem, Not by Delivering the Answer
Start by Understanding the Problem, Not by Delivering the Answer
 
Artificial Intelligence for Product Managers by former Yahoo! PM
Artificial Intelligence for Product Managers by former Yahoo! PMArtificial Intelligence for Product Managers by former Yahoo! PM
Artificial Intelligence for Product Managers by former Yahoo! PM
 
Future of HR Technology
Future of HR TechnologyFuture of HR Technology
Future of HR Technology
 
SSE 2017 10-09
SSE 2017 10-09SSE 2017 10-09
SSE 2017 10-09
 
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power SessionGrowth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
Growth Marketing Conference 2017 - David Arnoux - Growth Hacking Power Session
 
How to Measure Important Data by fmr Booking.com Product Owner
How to Measure Important Data by fmr Booking.com Product OwnerHow to Measure Important Data by fmr Booking.com Product Owner
How to Measure Important Data by fmr Booking.com Product Owner
 
Fintech 2017 Edinburgh (Day 1)
Fintech 2017 Edinburgh (Day 1)Fintech 2017 Edinburgh (Day 1)
Fintech 2017 Edinburgh (Day 1)
 
Digital disruption
Digital disruptionDigital disruption
Digital disruption
 

More from Tathagat Varma

Can AI finally "cure" the Marketing Myopia?
Can AI finally "cure" the Marketing Myopia?Can AI finally "cure" the Marketing Myopia?
Can AI finally "cure" the Marketing Myopia?
Tathagat Varma
 
AI in Manufacturing: Opportunities & Challenges
AI in Manufacturing: Opportunities & ChallengesAI in Manufacturing: Opportunities & Challenges
AI in Manufacturing: Opportunities & Challenges
Tathagat Varma
 
Preparing for the next ________?
Preparing for the next ________?Preparing for the next ________?
Preparing for the next ________?
Tathagat Varma
 
AI in Business: Opportunities & Challenges
AI in Business: Opportunities & ChallengesAI in Business: Opportunities & Challenges
AI in Business: Opportunities & Challenges
Tathagat Varma
 
Leadership Agility Mindsets
Leadership Agility MindsetsLeadership Agility Mindsets
Leadership Agility Mindsets
Tathagat Varma
 
Building an AI Startup
Building an AI StartupBuilding an AI Startup
Building an AI Startup
Tathagat Varma
 
Agility in an AI / DS / ML Project
Agility in an AI / DS / ML ProjectAgility in an AI / DS / ML Project
Agility in an AI / DS / ML Project
Tathagat Varma
 
Cognitive Chasms
Cognitive ChasmsCognitive Chasms
Cognitive Chasms
Tathagat Varma
 
AI Technology Delivering Business Value
AI Technology Delivering Business Value AI Technology Delivering Business Value
AI Technology Delivering Business Value
Tathagat Varma
 
Nurturing Innovation Mindset
Nurturing Innovation MindsetNurturing Innovation Mindset
Nurturing Innovation Mindset
Tathagat Varma
 
Thought Leadership
Thought LeadershipThought Leadership
Thought Leadership
Tathagat Varma
 
PMOs and Complexity Management
PMOs and Complexity ManagementPMOs and Complexity Management
PMOs and Complexity Management
Tathagat Varma
 
An Introduction to the Systematic Inventive Thinking (SIT) Method
An Introduction to the Systematic Inventive Thinking (SIT) MethodAn Introduction to the Systematic Inventive Thinking (SIT) Method
An Introduction to the Systematic Inventive Thinking (SIT) Method
Tathagat Varma
 
Agile at Scale
Agile at ScaleAgile at Scale
Agile at Scale
Tathagat Varma
 
I blog...therefore I am!
I blog...therefore I am!I blog...therefore I am!
I blog...therefore I am!
Tathagat Varma
 
Bridging the gap between Education and Learning
Bridging the gap between Education and LearningBridging the gap between Education and Learning
Bridging the gap between Education and Learning
Tathagat Varma
 
Is my iceberg melting?
Is my iceberg melting?Is my iceberg melting?
Is my iceberg melting?
Tathagat Varma
 
Digital Business Model Innovation
Digital Business Model InnovationDigital Business Model Innovation
Digital Business Model Innovation
Tathagat Varma
 
25 Years of Evolution of Software Product Management: A practitioner's perspe...
25 Years of Evolution of Software Product Management: A practitioner's perspe...25 Years of Evolution of Software Product Management: A practitioner's perspe...
25 Years of Evolution of Software Product Management: A practitioner's perspe...
Tathagat Varma
 
Agility from First Principles
Agility from First PrinciplesAgility from First Principles
Agility from First Principles
Tathagat Varma
 

More from Tathagat Varma (20)

Can AI finally "cure" the Marketing Myopia?
Can AI finally "cure" the Marketing Myopia?Can AI finally "cure" the Marketing Myopia?
Can AI finally "cure" the Marketing Myopia?
 
AI in Manufacturing: Opportunities & Challenges
AI in Manufacturing: Opportunities & ChallengesAI in Manufacturing: Opportunities & Challenges
AI in Manufacturing: Opportunities & Challenges
 
Preparing for the next ________?
Preparing for the next ________?Preparing for the next ________?
Preparing for the next ________?
 
AI in Business: Opportunities & Challenges
AI in Business: Opportunities & ChallengesAI in Business: Opportunities & Challenges
AI in Business: Opportunities & Challenges
 
Leadership Agility Mindsets
Leadership Agility MindsetsLeadership Agility Mindsets
Leadership Agility Mindsets
 
Building an AI Startup
Building an AI StartupBuilding an AI Startup
Building an AI Startup
 
Agility in an AI / DS / ML Project
Agility in an AI / DS / ML ProjectAgility in an AI / DS / ML Project
Agility in an AI / DS / ML Project
 
Cognitive Chasms
Cognitive ChasmsCognitive Chasms
Cognitive Chasms
 
AI Technology Delivering Business Value
AI Technology Delivering Business Value AI Technology Delivering Business Value
AI Technology Delivering Business Value
 
Nurturing Innovation Mindset
Nurturing Innovation MindsetNurturing Innovation Mindset
Nurturing Innovation Mindset
 
Thought Leadership
Thought LeadershipThought Leadership
Thought Leadership
 
PMOs and Complexity Management
PMOs and Complexity ManagementPMOs and Complexity Management
PMOs and Complexity Management
 
An Introduction to the Systematic Inventive Thinking (SIT) Method
An Introduction to the Systematic Inventive Thinking (SIT) MethodAn Introduction to the Systematic Inventive Thinking (SIT) Method
An Introduction to the Systematic Inventive Thinking (SIT) Method
 
Agile at Scale
Agile at ScaleAgile at Scale
Agile at Scale
 
I blog...therefore I am!
I blog...therefore I am!I blog...therefore I am!
I blog...therefore I am!
 
Bridging the gap between Education and Learning
Bridging the gap between Education and LearningBridging the gap between Education and Learning
Bridging the gap between Education and Learning
 
Is my iceberg melting?
Is my iceberg melting?Is my iceberg melting?
Is my iceberg melting?
 
Digital Business Model Innovation
Digital Business Model InnovationDigital Business Model Innovation
Digital Business Model Innovation
 
25 Years of Evolution of Software Product Management: A practitioner's perspe...
25 Years of Evolution of Software Product Management: A practitioner's perspe...25 Years of Evolution of Software Product Management: A practitioner's perspe...
25 Years of Evolution of Software Product Management: A practitioner's perspe...
 
Agility from First Principles
Agility from First PrinciplesAgility from First Principles
Agility from First Principles
 

Recently uploaded

Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital Banking
Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital  BankingCheslyn Jacobs- TymeBank: Building Consumer Trust in Digital  Banking
Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital Banking
itnewsafrica
 
Discover who your target audience is and reach them
Discover who your target audience is and reach themDiscover who your target audience is and reach them
Discover who your target audience is and reach them
Quibble
 
Growth Buyouts - The Dawn of the GBO (Slow Ventures)
Growth Buyouts - The  Dawn of the GBO (Slow Ventures)Growth Buyouts - The  Dawn of the GBO (Slow Ventures)
Growth Buyouts - The Dawn of the GBO (Slow Ventures)
Razin Mustafiz
 
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
PYROTECH GROUP
 
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
itnewsafrica
 
Navigating Change Strategies for Effective Transition and Operational Plannin...
Navigating Change Strategies for Effective Transition and Operational Plannin...Navigating Change Strategies for Effective Transition and Operational Plannin...
Navigating Change Strategies for Effective Transition and Operational Plannin...
Brian Frerichs
 
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdfDEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
unosafeads
 
Managing Customer & User Experience of Customers
Managing Customer & User Experience of CustomersManaging Customer & User Experience of Customers
Managing Customer & User Experience of Customers
SalmanTahir60
 
Staffan Canback - The 18 Rays of Project Management
Staffan Canback - The 18 Rays of Project ManagementStaffan Canback - The 18 Rays of Project Management
Staffan Canback - The 18 Rays of Project Management
Tellusant, Inc.
 
Corporate Governance for South African Mining Companies
Corporate Governance for South African Mining CompaniesCorporate Governance for South African Mining Companies
Corporate Governance for South African Mining Companies
James AH Campbell
 
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAAPAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
lawrenceads01
 
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAAPETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
lawrenceads01
 
Top Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdfTop Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdf
Top IT Marketing
 
Satta matka guessing Kalyan result sattamatka
Satta matka guessing Kalyan result sattamatkaSatta matka guessing Kalyan result sattamatka
Satta matka guessing Kalyan result sattamatka
➑➌➋➑➒➎➑➑➊➍
 
What is Venture Client for Startup entrepreneur
What is Venture Client for Startup entrepreneurWhat is Venture Client for Startup entrepreneur
What is Venture Client for Startup entrepreneur
Gokul Rangarajan
 
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAAPETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
lawrenceads01
 
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
dimplekumaridk322
 
Importance of Quality Transformations in VUCA World
Importance of Quality Transformations in VUCA WorldImportance of Quality Transformations in VUCA World
Importance of Quality Transformations in VUCA World
Ankur860831
 
Guide to Obtaining a Money Changer License in Singapore
Guide to Obtaining a Money Changer License in SingaporeGuide to Obtaining a Money Changer License in Singapore
Guide to Obtaining a Money Changer License in Singapore
Enterslice
 
TALENT ACQUISITION AND MANAGEMENT LECTURE 2
TALENT ACQUISITION AND MANAGEMENT LECTURE 2TALENT ACQUISITION AND MANAGEMENT LECTURE 2
TALENT ACQUISITION AND MANAGEMENT LECTURE 2
projectseasy
 

Recently uploaded (20)

Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital Banking
Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital  BankingCheslyn Jacobs- TymeBank: Building Consumer Trust in Digital  Banking
Cheslyn Jacobs- TymeBank: Building Consumer Trust in Digital Banking
 
Discover who your target audience is and reach them
Discover who your target audience is and reach themDiscover who your target audience is and reach them
Discover who your target audience is and reach them
 
Growth Buyouts - The Dawn of the GBO (Slow Ventures)
Growth Buyouts - The  Dawn of the GBO (Slow Ventures)Growth Buyouts - The  Dawn of the GBO (Slow Ventures)
Growth Buyouts - The Dawn of the GBO (Slow Ventures)
 
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
PROVIDING THE WORLD WITH EFFECTIVE & EFFICIENT LIGHTING SOLUTIONS SINCE 1976
 
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
 
Navigating Change Strategies for Effective Transition and Operational Plannin...
Navigating Change Strategies for Effective Transition and Operational Plannin...Navigating Change Strategies for Effective Transition and Operational Plannin...
Navigating Change Strategies for Effective Transition and Operational Plannin...
 
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdfDEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
DEKISH ELEVATOR INDIA PVT LTD Brochure.pdf
 
Managing Customer & User Experience of Customers
Managing Customer & User Experience of CustomersManaging Customer & User Experience of Customers
Managing Customer & User Experience of Customers
 
Staffan Canback - The 18 Rays of Project Management
Staffan Canback - The 18 Rays of Project ManagementStaffan Canback - The 18 Rays of Project Management
Staffan Canback - The 18 Rays of Project Management
 
Corporate Governance for South African Mining Companies
Corporate Governance for South African Mining CompaniesCorporate Governance for South African Mining Companies
Corporate Governance for South African Mining Companies
 
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAAPAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
PAWFESSIONAL ELVA MAX.pdfAAAAAAAAAAAAAAAAAAA
 
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAAPETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
PETAVIT SIP-05.pdfAAAAAAAAAAAAAAAAAAAAAAAAA
 
Top Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdfTop Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdf
 
Satta matka guessing Kalyan result sattamatka
Satta matka guessing Kalyan result sattamatkaSatta matka guessing Kalyan result sattamatka
Satta matka guessing Kalyan result sattamatka
 
What is Venture Client for Startup entrepreneur
What is Venture Client for Startup entrepreneurWhat is Venture Client for Startup entrepreneur
What is Venture Client for Startup entrepreneur
 
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAAPETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
PETAVIT MICHAEL TAY.pdfAAAAAAAAAAAAAAAAAAAA
 
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
 
Importance of Quality Transformations in VUCA World
Importance of Quality Transformations in VUCA WorldImportance of Quality Transformations in VUCA World
Importance of Quality Transformations in VUCA World
 
Guide to Obtaining a Money Changer License in Singapore
Guide to Obtaining a Money Changer License in SingaporeGuide to Obtaining a Money Changer License in Singapore
Guide to Obtaining a Money Changer License in Singapore
 
TALENT ACQUISITION AND MANAGEMENT LECTURE 2
TALENT ACQUISITION AND MANAGEMENT LECTURE 2TALENT ACQUISITION AND MANAGEMENT LECTURE 2
TALENT ACQUISITION AND MANAGEMENT LECTURE 2
 

Real Time Quality

  • 2. The complexity is increasing…
  • 4. And so does the cloud…
  • 5. …and will only get “10X’ed”!!!
  • 6. Welcome to the future…!
  • 7. Big questions… What is the meaning of “quality” in this world? How does the scale and pace impact quality? What are the directions ahead?
  • 8. From Traditional to Agile… Known Requirements Stable Technology Static Business Models Dynamic Requirements Ever-changing Technology Evolving Business Models Old World New World Quality = conformance Quality = capabilities
  • 9. The big shift in Quality… 1960s: Waterfall Model 1970s: Software Engineering 1980s: Spiral Model, RAD, SSAD, IID 1990s: Big Process Movement (CMM, ISO, 6 Sigma), V-model 2000s: Agile, XP, Scrum, Lean, Kanban, CI, TDD, ATDD, BDD 2010s: CD, Web Performance, Lean Startups, Business Model, Design Thinking, Customer Development, A/B Testing Now: App Performance, Data Quality, Prediction Quality, DevOps, DevSecOps, NoOps… Near future: ML/AI Quality, IOT, …
  • 10. Business is The New Quality! Software (test the code) Product (test against specs) Service (test for SLAs) Business (just get the $$$)
  • 12. Multiple Daily Builds: 3X up! https://blog.newrelic.com/2016/02/04/data-culture-survey-results-faster-deployment/
  • 13. High performers are killing it!
  • 14. …and the metrics are showing!
  • 15. Apollo - Amazon’s Deployment Engine Autonomous teams own their service, and directly interact with customers Apollo was created to reliably deploy code at Amazon scale (2014) In past 12months, Apollo was used for 50M deployments. That one per second!
  • 16. Data Quality Complete, Valid, Consistent, Timely, Accurate (2002) Cost of poor data quality (US): $600B (2009) Average company loses $8m due to poor data quality, as per Gartner (2014) Average company loses 12% revenue due to bad data The challenge is to assure high data quality…
  • 17. Learning Quality An estimated 30% of Amazon’s revenue comes from recommendation engines! Worldwide average is 12% 60% of clicks on YouTube homepage due to recommended videos! With big data, how do you ensure high learning and prediction quality…in real time?
  • 18. Examples… Is this picture offensive or not? Is this a spam mail or not? Is “Big Ben” a monument, a movie or a book? Whom to target for the next fashion product? Should you offer discount to this shopper? Is this the right recommendation for you? Remember TAY :) …
  • 19. So, what’s Real Time Quality? The ability of an org to respond in real- time to a crisis or an opportunity by offering high-quality product, feature, fix, service, recommendation, etc… using high-quality data and machine learning and prediction models
  • 21. Recap IT Deployment is getting (near) real time, and increasingly available off-the-shelf! Business decisions are getting (near) real time, and expect IT to support it. The notion of quality needs to support this scenario with increased capabilities Quality will increasingly mean quality of data, quality of learning, quality of recommendation, quality of decisions, etc.…all made in real time! This is Real Time Quality!
  • 22. References Google runs on 5000 times more code than the original space shuttle, https://www.weforum.org/agenda/ 2016/07/google-runs-on-5000-times-more-code-than-the-original-space-shuttle Codebases - Millions of lines of code, http://www.informationisbeautiful.net/visualizations/million- lines-of-code/ The Internet of Things Explained, http://www.i-scoop.eu/internet-of-things/ Deploying at GitHub, https://github.com/blog/1241-deploying-at-github https://www.quora.com/How-do-big-companies-like-Facebook-Google-manage-software-releases- without-causing-system-outages-and-poor-user-experience http://www.allthingsdistributed.com/2014/11/apollo-amazon-deployment-engine.html https://www.quora.com/What-is-Amazon-Apollo DevOps 2016 Report https://astheqaworldturns.wordpress.com/2011/03/03/the-evolution-of-software-qa/ http://www.hugeinc.com/ideas/perspective/evolving-qa http://www.testingexcellence.com/evolution-software-quality-assurance-test-engineering/ https://econsultancy.com/blog/64612-the-cost-of-bad-data-stats/