The document discusses the need for organizations to shift testing practices to keep up with changes in technology, customers, and business models. It advocates for a "Shift-Up" approach where testing is continuous, leverages AI and automation, and accounts for a variety of customer types and scenarios. This Shift-Up helps complete the DevOps circuit by enabling earlier testing, better coverage across technologies, and continuous monitoring to surpass customer expectations.

1. Shift Up!

2. shift up

3. Quality is Subjective, and that’s
ok!!
o Businesses are Interconnected
o Branding is just as important as quality
o Relationships are more persistent and less
transactional
The Business Changes
o They want to be delighted…always
o They have different, and maybe conflicting, worldviews
o Different Spending Habits
o More vocal than ever
The Customer Changes
o Migration to SaaS and Cloud Technologies
o IoT and Edge are more common
o AI, Technology Stacks, Machine Learning, and
Analytics
The Technology Changes
shift up

4. One Company, two big
paradigm shifts
1993: We Adapt to the Tech
2018: The Tech Adapts to Us

5. Shift-Left and Shift-Right aren’t enough
Shift-Left
o More Test Coverage
o Earlier Detection
o Lower Costs
o Advocate higher in the IT
Chain
Shift-Right
o Faster to Production
o Faster than your
competition
o Better Automation?
o True DevOps and CI/CD?
shift up

6. It’s Iterative Waterfall!
Dev without Ops is not DevOps
shift up

7. Shift-UP
Continuous Testing Becomes Continuous QA
o Ethnography to
understand your
customer
o Psychometric
analysis to
measure capacity
o Being able to
cover multiple
customer types
with a minimal
number of
personas
o Test management tools
are a thing of the past
o AI centric tools that can
leverage any automation
and plug into multiple
Cognitive Computing
engines
o Tools need to be
integrated all the time
o Edge computing
o SMAC
o New tech
o No tech
o B2B, B2C, C2B
o Metrics, analytics, and
monitoring need to be fed
into testing tool real-time
o Humans still have limited
potential and experience
The
customer is
always right,
and so is that
one, and that
one too.
Out of one tool,
many.
Which
Channel?
All of them!
Actions speak
louder than
words.
shift up

8. Shift-Up lets you
“Think of Yourself as a Customer”
Directed
Tests
Bug
Hunting
Coverage
Analysis
Feature
Analysis
Analytics &
Monitoring
Custom AI
Gives you new automated tests that,
among other things:
o Tell you want you need to test
o Tell you what you don’t need
to test
o Mimic real users
o Integrate digital and AI
assisted events
o Account for natural disaster, geopolitics,
the unknown
o Let’s the Developers Develop
o Re-Establishes the need for Domain Experts
shift up

9. Shift-Up Completes the
Circuit
Shift-Left
§ AI Driven Test Coverage
§ Meaningful Analytics
§ Test across Technologies
§ Democratize Testing
Shift-Right
§ Surpass Customer
Expectations
§ Continuous Monitoring
§ Micro-shifts
§ True DevOps and CI/CD
Shift-Up
shift up

10. This is DevOps
shift up

11. shift up
Your Call to Action
• Testing needs to continue its fight for position
• Show value to the Customer, IT, and Management
• Developers need bandwidth and freedom to create
Continue what we’ve started
• Good AI engines should integrate with your tool sets
• Your processes will evolve, but not because of the Tool
• Focus on people, democratize testing
• Look at external products and tools. Consider the
maintenance costs of building your own
Build on what you have, don’t burn it down
• Tools need to enable and empower you
• You need to consider how a customer will use your product,
which may differ from requirements
• Always question the hype
Think of yourself as a customer
• This is a time of unprecedented
change in Quality Assurance
• QA Professionals can be the bridge
between your customers and your
business
• It’s only going to get more complex

12. Live the Technology you Love!!