SlideShare a Scribd company logo
Киев 2017
Первый в Украине фестиваль тестирования
E2E testing: Challenges and
recommendation in test process
organization for cross-integration teams
Vlada Benyukh
Киев 2017
Первый в Украине фестиваль тестирования
Speaker info
Vlada Benyukh, Ukraine
QA Manager/QA Consultant at Ciklum, TCoE
•7 years in QA
•Manual QA Engineer, QA Manager, mentor
•Certified: SAFe, ICAgile, ISTQB
in/vlada-benyukh
Киев 2017
Agenda
1. E2E testing in cross-integration teams, What is it?
2. Test process and approach
3. Infrastructure management
4. Collaboration
5. Test team structure
6. Automation setup
7. Questions
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
What is E2E testing?
Main goal is to identify system dependencies and to ensure
that the data integrity is maintained between various
applications/components correctly
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
What is E2E testing in cross-
integration teams?
Expectation
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
What is E2E testing in cross-
integration teams?
Process and approach
Infrastructure management
Communication and
collaboration
Most of the challenges in a E2E team relates
to cross-integration work:
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Process challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Process challenges – Team
structure
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Why team structure was a
challenge?
 3 QA Automation
Specialists
 1 Automation QA Lead
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
1. Understanding of the systems flows
2. Accesses to the systems
3. Requirements for end-to-end flows
4. Test Design for end-to-end flows
5. Test data for each system
6. Test environment readiness
Why team structure was a
challenge?
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Do not change team structure until challenges resolved…
Why team structure was a
challenge?
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Process challenges – Solution
1. Systems:
 7 separate systems which integrated into 1 CRM
 1 common aggregation level for all systems
 1 common integration level for all systems
E2E testing: Challenges and recommendation in test process organization for cross integration teams
2. Many development and test teams (in different
countries and time zones)
Киев 2017
Test Process challenges – Solution
Gather knowledge about the systems!
 Get access to the systems
 Understand systems specific and
functionality
 Get information about architecture
overview and technologies used
 Figure out scope and readiness dates
of the systems
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Process challenges – Solution
Gather knowledge about key representatives in
each system!
 System teams
 Integration development system teams
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Ask key representatives about
end-to-end flows
Gather, document and approve
acceptance criteria
Prioritize acceptance criteria
Requirements challenges – What
was the plan?
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
No understanding and goal of
end-to-end team
No requirements for end-to-end
flows
No responsible person for end-
to-end team
Requirements challenges – What
was in reality?
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Requirements challenges
How to get requirements …
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Get system requirements
Explain the goal of end-to-end
testing
Review system requirements
Document, prioritize and
approve with business side
Requirements challenges – Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Requirements challenges – Summary
E2E testing: Challenges and recommendation in test process organization for cross integration teams
1. General knowledge about system were gathered
2. Scope and priorities for end-to-end were identified
3. Detailed Requirements for end-to-end flows were
documented
Киев 2017
Test Design challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
• No technical skills to create test
documentation based on the best
practices
• No input test data for each
system
Test Design challenges - Problem
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Design challenges – Solution
• Explain the necessity of manual QA
specialists to senior management
• Involve manual QA Engineers from
system teams in test cases creation
• Motivate automation team to
collaborate with manual QA
Engineers
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
How motivate automation team to create test
cases?
Test Design challenges – Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
 Explain the temporarily situation and
what can happen without end-to-end
team involvement
 Be involved and continue to work on
automation direction together
Test Design challenges – Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
 Ask involved Manual QA Engineers to
be responsible for test cases creation
 Define test case template which will
be used by manual and automation
QAs
 Structure test cases by functionality
and priorities
Test Design challenges – Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Design challenges – Summary
E2E testing: Challenges and recommendation in test process organization for cross integration teams
1. Responsible team members for test cases creation
were defined
2. Structure and template were identified
3. Flows for end-to-end were covered by test cases
Киев 2017
Testing approach agreement across
teams
Agreements should be aligned before starting test
execution activities
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Testing approach agreement across
teams
Discuss process/approach with
teams
Involve all stakeholders in
process/approaches discussions
Align procedures across teams
Document all agreements
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Testing approach – Testing Order
Smoke
Acceptance critical flows
Regression
UAT
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Testing approach – Testing Order
Type of Test Scope Outcome
Smoke One End-to-end flow
for most critical
functionality
Blocker bugs
Acceptance critical
flows
End-to-end flows P1/P2/P3/P4
bugs
Regression P1/P2 P1/P2 test cases P1/P2 bugs
Regression P3/P4 P3/P4 test cases P3/P4 bugs
UAT User Acceptance
Testing
P1/P2 and
P3 bugs
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Testing approach – Defect
management
RAISE ON E2E
BOARD
DISCUSS ON
BUG TRIAGE
DUPLICATE
AND ASSIGN
TO A PROPER
TEAM
ANALYSE CASE
WHEN DEFECT
HAPPENED
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test Execution challenges - Solution
• Ask Manual QA representatives focus their
attention on execution activities from manual
point of view
• Involve Automation QA representatives in
technical details analysis to find a workaround
for infrastructure challenges
!!! Infrastructure challenges will be covered on the next section!!!
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Infrastructure challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Test environment requirements for
verification of end-to-end flows:
 All items should be processed from
start system to end system
automatically
Infrastructure challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
But what we had….
Infrastructure challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Based on the system configurations, limitations and application
specific, items are integrated from start system to end
application into two different ways:
 Semi-automatically
 Non-automatically
Infrastructure challenges - Problem
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Automation QA team was involved to resolve next items:
 Data formats and mappings for items processing
 Access to file transfer folders which can help to
make items processed to end system
 Get permissions to monitor messages to diagnose
the problem
Infrastructure challenges - Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Infrastructure challenges – semi-
automatic procedure
Creation
Status
Verification
Verification
in CRM
Automation QAsManual QAs
• Create items in start
system
• Verify that details
about created items
are stored properly
• Track the processing
status and monitor
issues
• Verify that item details are displayed in end system
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Infrastructure challenges – non-
automated procedure
Creation
Status
Verification
Verification
in CRM
• Create items in start
system
• Verify that details about
created items are stored
properly
• Generate data formats
which required for
processing
• Verify that item details are displayed in end system
Manual
Processing
• Process and track the
processing status and
monitor issues
Automation QAsManual QAs
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Infrastructure challenges –
Summary
E2E testing: Challenges and recommendation in test process organization for cross integration teams
1. End-to-end flows were executed successfully
2. End-to-end scenarios found bugs and discrepancies
in the systems functionality
Киев 2017
Collaboration challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Collaboration challenges – Cross
teams
What is it if NO:
1. Frequency and scope for updates
2. Release readiness dates
3. Changes in the systems
4. Possible impact and risks for end-to-end
flows
1. Unexpected issues occur while testing
2. Possibly unexpected configuration issues
3. Dependencies are not tracked and mitigated
in time
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
How to avoid issues?
Collaboration challenges – Cross
teams
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Regular cross-teams Sync Ups
Participants:
 Project management teams
representatives
 Integration Program Manager
 Team Tech Leads
 E2E QA Lead
Goals:
 Define scope for updates
 Get system updates dates
 Analyze and mitigate risks that might
affect E2E testing before testing starts
 Escalate critical problems
 Discuss other common problems and
questions
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Collaboration challenges – cross-
teams progress understanding
What is it if NO:
1. Scope and activities for end-to-end testing
2. Understanding of the progress end-to-end
testing
3. Risks and blockers for end-to-end testing
4. Release readiness dates
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
How to avoid issues?
Collaboration challenges – cross-
teams progress understanding
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Regular E2E team Sync Up
Participants:
 Integration Program Manager
 E2E QA Lead
 E2E key QA specialists
Goals:
 Show the progress
 Escalate critical problems
 Discuss other common problems and
questions
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Example of Daily Progress Visibility
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017E2E testing: Challenges and recommendation in test process organization for cross integration teams
Example of Daily Progress Visibility
Киев 2017
Example of Daily Progress Visibility
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Collaboration challenges – Summary
E2E testing: Challenges and recommendation in test process organization for cross integration teams
1. Regular updates on system updates and readiness were
completely clear
2. Risks were identified and mitigated regularly
3. Critical problems were escalated in time
4. Test progress and project health were synchronized
between teams
Киев 2017E2E testing: Challenges and recommendation in test process organization for cross integration teams
Test Team structure
Киев 2017
QA Lead
- QA Process and
Approaches
implementation
- Cross team ongoing
QA work planning and
monitoring
- Regular QA reporting
- People management
between teams
- Support in building
and aligning QA
automation approach
Manual QAs
-Main knowledge
keepers in the systems
- Responsible for test
cases preparation and
execution semi-
automated procedure
- Escalate issues
- Define dependencies
and quality risks. Inform
about them in time
Automation QAs
- Support in test cases
creation
- Responsible for
incomplete test
procedure processing
testing
- Responsible for test
automation
implementation
- Escalate issues
- Define dependencies
and quality risks.Inform
about them in time
Test Team structure - Solution
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
QA Lead
QA Manual QA AutomationQA Manager
QA Manual Lead
QA Manual Lead
Middle QA
Middle QA
Senior QA
Middle QA
Middle QA
Senior QA Senior QA
Automation team
Test Team structure - Solution
Team 1 Team 2
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Automation challenges
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Automation challenges – What was
it?
2. Complex and obsolete architecture
1. End-to-end flow is not fully automated
3. Many external and internal dependencies
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Automation challenges – What was
solution?
1. Get access to systems via API to create items
2. Generate required data formats and make to be processed
it automatically
3. Automate validation of items in common CRM
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Automation challenges – Order to
automate
Smoke Regression
Acceptance
flows
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Recommendations
1. Do not change team structure until all
important challenges were not clarified
2. Be proactive and look for the solutions
3. Do not try to resolve all issues by yourself
4. Collaborate with stakeholders and systems
team members
E2E testing: Challenges and recommendation in test process organization for cross integration teams
Киев 2017
Questions
E2E testing: Challenges and recommendation in test process organization for cross integration teams

More Related Content

What's hot

Btd presentation-2011
Btd presentation-2011Btd presentation-2011
Btd presentation-2011
kinow
 
Introduction to Continuous Delivery (BBWorld/DevCon 2013)
Introduction to Continuous Delivery (BBWorld/DevCon 2013)Introduction to Continuous Delivery (BBWorld/DevCon 2013)
Introduction to Continuous Delivery (BBWorld/DevCon 2013)
Mike McGarr
 
Deploying to Production with Your Eyes Open | SeaLights | Jason Wides
Deploying to Production with Your Eyes Open | SeaLights | Jason WidesDeploying to Production with Your Eyes Open | SeaLights | Jason Wides
Deploying to Production with Your Eyes Open | SeaLights | Jason Wides
Bar Kofman
 
Unit testing for project managers
Unit testing for project managersUnit testing for project managers
Unit testing for project managers
Zend by Rogue Wave Software
 
How technical excellence helps in LeSS adoption
How technical excellence helps in LeSS adoptionHow technical excellence helps in LeSS adoption
How technical excellence helps in LeSS adoption
Anton Bevzuk
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
Dr. Alexander Schwartz
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
JAXLondon2014
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
QA Club Kiev
 
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
QAFest
 
Пирамида Тестирования через призму ROI калькулятора и прочая геометрия
Пирамида Тестирования через призму ROI калькулятора и прочая геометрияПирамида Тестирования через призму ROI калькулятора и прочая геометрия
Пирамида Тестирования через призму ROI калькулятора и прочая геометрия
SQALab
 
Owasp Eu Summit 2008 Owasp Testing Guide V3
Owasp Eu Summit 2008 Owasp Testing Guide V3Owasp Eu Summit 2008 Owasp Testing Guide V3
Owasp Eu Summit 2008 Owasp Testing Guide V3
Matteo Meucci
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
Hicham El Hammouchi
 
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
Steve Lange
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
Ashish Kumar
 
Agileee 2012
Agileee 2012Agileee 2012
Agileee 2012
Wiktor Żołnowski
 
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
Trójmiejska Grupa Testerska
 
DevOps and All the Continuouses w/ Helen Beal
DevOps and All the Continuouses w/ Helen BealDevOps and All the Continuouses w/ Helen Beal
DevOps and All the Continuouses w/ Helen Beal
Sonatype
 
Security Implications for a DevOps Transformation
Security Implications for a DevOps TransformationSecurity Implications for a DevOps Transformation
Security Implications for a DevOps Transformation
DevOps.com
 
Creating Maintainable Automated Acceptance Tests
Creating Maintainable Automated Acceptance TestsCreating Maintainable Automated Acceptance Tests
Creating Maintainable Automated Acceptance Tests
Jez Humble
 
Peer Code Review: In a Nutshell
Peer Code Review: In a NutshellPeer Code Review: In a Nutshell
Peer Code Review: In a Nutshell
Atlassian
 

What's hot (20)

Btd presentation-2011
Btd presentation-2011Btd presentation-2011
Btd presentation-2011
 
Introduction to Continuous Delivery (BBWorld/DevCon 2013)
Introduction to Continuous Delivery (BBWorld/DevCon 2013)Introduction to Continuous Delivery (BBWorld/DevCon 2013)
Introduction to Continuous Delivery (BBWorld/DevCon 2013)
 
Deploying to Production with Your Eyes Open | SeaLights | Jason Wides
Deploying to Production with Your Eyes Open | SeaLights | Jason WidesDeploying to Production with Your Eyes Open | SeaLights | Jason Wides
Deploying to Production with Your Eyes Open | SeaLights | Jason Wides
 
Unit testing for project managers
Unit testing for project managersUnit testing for project managers
Unit testing for project managers
 
How technical excellence helps in LeSS adoption
How technical excellence helps in LeSS adoptionHow technical excellence helps in LeSS adoption
How technical excellence helps in LeSS adoption
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
QA Fest 2015. Владимир Примаков. Автоматизация нестандартной отчетности из JI...
 
Пирамида Тестирования через призму ROI калькулятора и прочая геометрия
Пирамида Тестирования через призму ROI калькулятора и прочая геометрияПирамида Тестирования через призму ROI калькулятора и прочая геометрия
Пирамида Тестирования через призму ROI калькулятора и прочая геометрия
 
Owasp Eu Summit 2008 Owasp Testing Guide V3
Owasp Eu Summit 2008 Owasp Testing Guide V3Owasp Eu Summit 2008 Owasp Testing Guide V3
Owasp Eu Summit 2008 Owasp Testing Guide V3
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
 
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
 
Agileee 2012
Agileee 2012Agileee 2012
Agileee 2012
 
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
TGT#16 - Pain of test automatization in PAAS/SAAS solutions - Krzysztof Lembi...
 
DevOps and All the Continuouses w/ Helen Beal
DevOps and All the Continuouses w/ Helen BealDevOps and All the Continuouses w/ Helen Beal
DevOps and All the Continuouses w/ Helen Beal
 
Security Implications for a DevOps Transformation
Security Implications for a DevOps TransformationSecurity Implications for a DevOps Transformation
Security Implications for a DevOps Transformation
 
Creating Maintainable Automated Acceptance Tests
Creating Maintainable Automated Acceptance TestsCreating Maintainable Automated Acceptance Tests
Creating Maintainable Automated Acceptance Tests
 
Peer Code Review: In a Nutshell
Peer Code Review: In a NutshellPeer Code Review: In a Nutshell
Peer Code Review: In a Nutshell
 

Similar to QA Fest 2017. Влада Бенюх.Организация End-to-End тестирования в cross-integration команде

Yuriy Malyi "E2E testing organization in multi-system projects"
Yuriy Malyi "E2E testing organization in multi-system projects"Yuriy Malyi "E2E testing organization in multi-system projects"
Yuriy Malyi "E2E testing organization in multi-system projects"
Dakiry
 
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
ITSM Academy, Inc.
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
Neotys
 
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP examINCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
systemsengineeringprep
 
Continuous Testing Landscape.pptx
Continuous Testing Landscape.pptxContinuous Testing Landscape.pptx
Continuous Testing Landscape.pptx
Marc Hornbeek
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT delivery
Rik Marselis
 
Balanced Agile Approach
Balanced Agile Approach Balanced Agile Approach
Balanced Agile Approach
Cary Xie
 
ATAGTR2017 Testing in DevOps Culture
ATAGTR2017 Testing in DevOps CultureATAGTR2017 Testing in DevOps Culture
ATAGTR2017 Testing in DevOps Culture
Agile Testing Alliance
 
Agile Testing - Challenges
Agile Testing - ChallengesAgile Testing - Challenges
Agile Testing - Challenges
Mohan Krishna Kona
 
Ch14
Ch14Ch14
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
Meghna Arora
 
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrum
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrumPete Rim - Cisco's agile journey, continuous delivery and scaling scrum
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrum
Scrum Australia Pty Ltd
 
Agile testing
Agile testingAgile testing
Agile testing
Raj Indugula
 
Quality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps cultureQuality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps culture
Rik Marselis
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
Yogindernath Gupta
 
Quality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAPQuality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAP
Rik Marselis
 
Agile Test Management
Agile Test ManagementAgile Test Management
Agile Test Management
franohara99
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or less
Vernon Stinebaker
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 

Similar to QA Fest 2017. Влада Бенюх.Организация End-to-End тестирования в cross-integration команде (20)

Yuriy Malyi "E2E testing organization in multi-system projects"
Yuriy Malyi "E2E testing organization in multi-system projects"Yuriy Malyi "E2E testing organization in multi-system projects"
Yuriy Malyi "E2E testing organization in multi-system projects"
 
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
DevOps Test Engineering: Putting the ‘Continuous’ in Testing, an ITSM Academy...
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP examINCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
INCOSE Systems Engineering Handbook and Changes to the CSEP/ASEP exam
 
Continuous Testing Landscape.pptx
Continuous Testing Landscape.pptxContinuous Testing Landscape.pptx
Continuous Testing Landscape.pptx
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT delivery
 
Balanced Agile Approach
Balanced Agile Approach Balanced Agile Approach
Balanced Agile Approach
 
ATAGTR2017 Testing in DevOps Culture
ATAGTR2017 Testing in DevOps CultureATAGTR2017 Testing in DevOps Culture
ATAGTR2017 Testing in DevOps Culture
 
Agile Testing - Challenges
Agile Testing - ChallengesAgile Testing - Challenges
Agile Testing - Challenges
 
Ch14
Ch14Ch14
Ch14
 
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
CT-ATLaS: Accelerate Preparation for ISTQB Agile Test Leadership at Scale Cer...
 
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrum
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrumPete Rim - Cisco's agile journey, continuous delivery and scaling scrum
Pete Rim - Cisco's agile journey, continuous delivery and scaling scrum
 
Agile testing
Agile testingAgile testing
Agile testing
 
Quality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps cultureQuality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps culture
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
 
Quality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAPQuality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAP
 
Agile Test Management
Agile Test ManagementAgile Test Management
Agile Test Management
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or less
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 

More from QAFest

QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилинQA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
QAFest
 
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The FutureQA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
QAFest
 
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
QAFest
 
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
QAFest
 
QA Fest 2019. Никита Галкин. Как зарабатывать больше
QA Fest 2019. Никита Галкин. Как зарабатывать большеQA Fest 2019. Никита Галкин. Как зарабатывать больше
QA Fest 2019. Никита Галкин. Как зарабатывать больше
QAFest
 
QA Fest 2019. Сергей Пирогов. Why everything is spoiled
QA Fest 2019. Сергей Пирогов. Why everything is spoiledQA Fest 2019. Сергей Пирогов. Why everything is spoiled
QA Fest 2019. Сергей Пирогов. Why everything is spoiled
QAFest
 
QA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
QA Fest 2019. Сергей Новик. Между мотивацией и выгораниемQA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
QA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
QAFest
 
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
QAFest
 
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
QAFest
 
QA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
QA Fest 2019. Иван Крутов. Bulletproof Selenium ClusterQA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
QA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
QAFest
 
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
QAFest
 
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
QAFest
 
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automationQA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
QAFest
 
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
QAFest
 
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
QAFest
 
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях ITQA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
QAFest
 
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложенииQA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
QAFest
 
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
QAFest
 
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
QAFest
 
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
QAFest
 

More from QAFest (20)

QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилинQA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
QA Fest 2019. Сергій Короленко. Топ веб вразливостей за 40 хвилин
 
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The FutureQA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future
 
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
QA Fest 2019. Doug Sillars. It's just too Slow: Testing Mobile application pe...
 
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
QA Fest 2019. Катерина Спринсян. Параллельное покрытие автотестами и другие и...
 
QA Fest 2019. Никита Галкин. Как зарабатывать больше
QA Fest 2019. Никита Галкин. Как зарабатывать большеQA Fest 2019. Никита Галкин. Как зарабатывать больше
QA Fest 2019. Никита Галкин. Как зарабатывать больше
 
QA Fest 2019. Сергей Пирогов. Why everything is spoiled
QA Fest 2019. Сергей Пирогов. Why everything is spoiledQA Fest 2019. Сергей Пирогов. Why everything is spoiled
QA Fest 2019. Сергей Пирогов. Why everything is spoiled
 
QA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
QA Fest 2019. Сергей Новик. Между мотивацией и выгораниемQA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
QA Fest 2019. Сергей Новик. Между мотивацией и выгоранием
 
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
QA Fest 2019. Владимир Никонов. Код Шредингера или зачем и как мы тестируем н...
 
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
QA Fest 2019. Владимир Трандафилов. GUI automation of WEB application with SV...
 
QA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
QA Fest 2019. Иван Крутов. Bulletproof Selenium ClusterQA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
QA Fest 2019. Иван Крутов. Bulletproof Selenium Cluster
 
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
QA Fest 2019. Николай Мижигурский. Миссия /*не*/выполнима: гуманитарий собесе...
 
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
QA Fest 2019. Володимир Стиран. Чим раніше – тим вигідніше, але ніколи не піз...
 
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automationQA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
QA Fest 2019. Дмитрий Прокопук. Mocks and network tricks in UI automation
 
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
QA Fest 2019. Екатерина Дядечко. Тестирование медицинского софта — вызовы и в...
 
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
QA Fest 2019. Катерина Черникова. Tune your P’s: the pop-art of keeping testa...
 
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях ITQA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
QA Fest 2019. Алиса Бойко. Какнезапутаться в коммуникативных сетях IT
 
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложенииQA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
QA Fest 2019. Святослав Логин. Как найти уязвимости в мобильном приложении
 
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
QA Fest 2019. Катерина Шепелєва та Інна Оснач. Що українцям потрібно знати пр...
 
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхр...
 
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
QA Fest 2019. Петр Тарасенко. QA Hackathon - The Cookbook 22
 

Recently uploaded

LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
RAHUL
 
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxBeyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
EduSkills OECD
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
History of Stoke Newington
 
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
National Information Standards Organization (NISO)
 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
haiqairshad
 
Level 3 NCEA - NZ: A Nation In the Making 1872 - 1900 SML.ppt
Level 3 NCEA - NZ: A  Nation In the Making 1872 - 1900 SML.pptLevel 3 NCEA - NZ: A  Nation In the Making 1872 - 1900 SML.ppt
Level 3 NCEA - NZ: A Nation In the Making 1872 - 1900 SML.ppt
Henry Hollis
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
deepaannamalai16
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
Nguyen Thanh Tu Collection
 
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
PECB
 
Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47
MysoreMuleSoftMeetup
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
Nguyen Thanh Tu Collection
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
Celine George
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
National Information Standards Organization (NISO)
 
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
Nguyen Thanh Tu Collection
 
Electric Fetus - Record Store Scavenger Hunt
Electric Fetus - Record Store Scavenger HuntElectric Fetus - Record Store Scavenger Hunt
Electric Fetus - Record Store Scavenger Hunt
RamseyBerglund
 
B. Ed Syllabus for babasaheb ambedkar education university.pdf
B. Ed Syllabus for babasaheb ambedkar education university.pdfB. Ed Syllabus for babasaheb ambedkar education university.pdf
B. Ed Syllabus for babasaheb ambedkar education university.pdf
BoudhayanBhattachari
 
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching AptitudeUGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
S. Raj Kumar
 
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDFLifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
Vivekanand Anglo Vedic Academy
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 

Recently uploaded (20)

LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
 
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxBeyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
 
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
 
Level 3 NCEA - NZ: A Nation In the Making 1872 - 1900 SML.ppt
Level 3 NCEA - NZ: A  Nation In the Making 1872 - 1900 SML.pptLevel 3 NCEA - NZ: A  Nation In the Making 1872 - 1900 SML.ppt
Level 3 NCEA - NZ: A Nation In the Making 1872 - 1900 SML.ppt
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
 
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...
 
Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
 
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
 
Electric Fetus - Record Store Scavenger Hunt
Electric Fetus - Record Store Scavenger HuntElectric Fetus - Record Store Scavenger Hunt
Electric Fetus - Record Store Scavenger Hunt
 
B. Ed Syllabus for babasaheb ambedkar education university.pdf
B. Ed Syllabus for babasaheb ambedkar education university.pdfB. Ed Syllabus for babasaheb ambedkar education university.pdf
B. Ed Syllabus for babasaheb ambedkar education university.pdf
 
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching AptitudeUGC NET Exam Paper 1- Unit 1:Teaching Aptitude
UGC NET Exam Paper 1- Unit 1:Teaching Aptitude
 
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDFLifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
Lifelines of National Economy chapter for Class 10 STUDY MATERIAL PDF
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 

QA Fest 2017. Влада Бенюх.Организация End-to-End тестирования в cross-integration команде

  • 1. Киев 2017 Первый в Украине фестиваль тестирования E2E testing: Challenges and recommendation in test process organization for cross-integration teams Vlada Benyukh
  • 2. Киев 2017 Первый в Украине фестиваль тестирования Speaker info Vlada Benyukh, Ukraine QA Manager/QA Consultant at Ciklum, TCoE •7 years in QA •Manual QA Engineer, QA Manager, mentor •Certified: SAFe, ICAgile, ISTQB in/vlada-benyukh
  • 3. Киев 2017 Agenda 1. E2E testing in cross-integration teams, What is it? 2. Test process and approach 3. Infrastructure management 4. Collaboration 5. Test team structure 6. Automation setup 7. Questions E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 4. Киев 2017 What is E2E testing? Main goal is to identify system dependencies and to ensure that the data integrity is maintained between various applications/components correctly E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 5. Киев 2017 What is E2E testing in cross- integration teams? Expectation E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 6. Киев 2017 What is E2E testing in cross- integration teams? Process and approach Infrastructure management Communication and collaboration Most of the challenges in a E2E team relates to cross-integration work: E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 7. Киев 2017 Test Process challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 8. Киев 2017 Test Process challenges – Team structure E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 9. Киев 2017 Why team structure was a challenge?  3 QA Automation Specialists  1 Automation QA Lead E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 10. Киев 2017 1. Understanding of the systems flows 2. Accesses to the systems 3. Requirements for end-to-end flows 4. Test Design for end-to-end flows 5. Test data for each system 6. Test environment readiness Why team structure was a challenge? E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 11. Киев 2017 Do not change team structure until challenges resolved… Why team structure was a challenge? E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 12. Киев 2017 Test Process challenges – Solution 1. Systems:  7 separate systems which integrated into 1 CRM  1 common aggregation level for all systems  1 common integration level for all systems E2E testing: Challenges and recommendation in test process organization for cross integration teams 2. Many development and test teams (in different countries and time zones)
  • 13. Киев 2017 Test Process challenges – Solution Gather knowledge about the systems!  Get access to the systems  Understand systems specific and functionality  Get information about architecture overview and technologies used  Figure out scope and readiness dates of the systems E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 14. Киев 2017 Test Process challenges – Solution Gather knowledge about key representatives in each system!  System teams  Integration development system teams E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 15. Киев 2017 Ask key representatives about end-to-end flows Gather, document and approve acceptance criteria Prioritize acceptance criteria Requirements challenges – What was the plan? E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 16. Киев 2017 No understanding and goal of end-to-end team No requirements for end-to-end flows No responsible person for end- to-end team Requirements challenges – What was in reality? E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 17. Киев 2017 Requirements challenges How to get requirements … E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 18. Киев 2017 Get system requirements Explain the goal of end-to-end testing Review system requirements Document, prioritize and approve with business side Requirements challenges – Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 19. Киев 2017 Requirements challenges – Summary E2E testing: Challenges and recommendation in test process organization for cross integration teams 1. General knowledge about system were gathered 2. Scope and priorities for end-to-end were identified 3. Detailed Requirements for end-to-end flows were documented
  • 20. Киев 2017 Test Design challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 21. Киев 2017 • No technical skills to create test documentation based on the best practices • No input test data for each system Test Design challenges - Problem E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 22. Киев 2017 Test Design challenges – Solution • Explain the necessity of manual QA specialists to senior management • Involve manual QA Engineers from system teams in test cases creation • Motivate automation team to collaborate with manual QA Engineers E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 23. Киев 2017 How motivate automation team to create test cases? Test Design challenges – Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 24. Киев 2017  Explain the temporarily situation and what can happen without end-to-end team involvement  Be involved and continue to work on automation direction together Test Design challenges – Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 25. Киев 2017  Ask involved Manual QA Engineers to be responsible for test cases creation  Define test case template which will be used by manual and automation QAs  Structure test cases by functionality and priorities Test Design challenges – Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 26. Киев 2017 Test Design challenges – Summary E2E testing: Challenges and recommendation in test process organization for cross integration teams 1. Responsible team members for test cases creation were defined 2. Structure and template were identified 3. Flows for end-to-end were covered by test cases
  • 27. Киев 2017 Testing approach agreement across teams Agreements should be aligned before starting test execution activities E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 28. Киев 2017 Testing approach agreement across teams Discuss process/approach with teams Involve all stakeholders in process/approaches discussions Align procedures across teams Document all agreements E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 29. Киев 2017 Testing approach – Testing Order Smoke Acceptance critical flows Regression UAT E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 30. Киев 2017 Testing approach – Testing Order Type of Test Scope Outcome Smoke One End-to-end flow for most critical functionality Blocker bugs Acceptance critical flows End-to-end flows P1/P2/P3/P4 bugs Regression P1/P2 P1/P2 test cases P1/P2 bugs Regression P3/P4 P3/P4 test cases P3/P4 bugs UAT User Acceptance Testing P1/P2 and P3 bugs E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 31. Киев 2017 Testing approach – Defect management RAISE ON E2E BOARD DISCUSS ON BUG TRIAGE DUPLICATE AND ASSIGN TO A PROPER TEAM ANALYSE CASE WHEN DEFECT HAPPENED E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 32. Киев 2017 Test Execution challenges - Solution • Ask Manual QA representatives focus their attention on execution activities from manual point of view • Involve Automation QA representatives in technical details analysis to find a workaround for infrastructure challenges !!! Infrastructure challenges will be covered on the next section!!! E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 33. Киев 2017 Infrastructure challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 34. Киев 2017 Test environment requirements for verification of end-to-end flows:  All items should be processed from start system to end system automatically Infrastructure challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 35. Киев 2017 But what we had…. Infrastructure challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 36. Киев 2017 Based on the system configurations, limitations and application specific, items are integrated from start system to end application into two different ways:  Semi-automatically  Non-automatically Infrastructure challenges - Problem E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 37. Киев 2017 Automation QA team was involved to resolve next items:  Data formats and mappings for items processing  Access to file transfer folders which can help to make items processed to end system  Get permissions to monitor messages to diagnose the problem Infrastructure challenges - Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 38. Киев 2017 Infrastructure challenges – semi- automatic procedure Creation Status Verification Verification in CRM Automation QAsManual QAs • Create items in start system • Verify that details about created items are stored properly • Track the processing status and monitor issues • Verify that item details are displayed in end system E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 39. Киев 2017 Infrastructure challenges – non- automated procedure Creation Status Verification Verification in CRM • Create items in start system • Verify that details about created items are stored properly • Generate data formats which required for processing • Verify that item details are displayed in end system Manual Processing • Process and track the processing status and monitor issues Automation QAsManual QAs E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 40. Киев 2017 Infrastructure challenges – Summary E2E testing: Challenges and recommendation in test process organization for cross integration teams 1. End-to-end flows were executed successfully 2. End-to-end scenarios found bugs and discrepancies in the systems functionality
  • 41. Киев 2017 Collaboration challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 42. Киев 2017 Collaboration challenges – Cross teams What is it if NO: 1. Frequency and scope for updates 2. Release readiness dates 3. Changes in the systems 4. Possible impact and risks for end-to-end flows 1. Unexpected issues occur while testing 2. Possibly unexpected configuration issues 3. Dependencies are not tracked and mitigated in time E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 43. Киев 2017 How to avoid issues? Collaboration challenges – Cross teams E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 44. Киев 2017 Regular cross-teams Sync Ups Participants:  Project management teams representatives  Integration Program Manager  Team Tech Leads  E2E QA Lead Goals:  Define scope for updates  Get system updates dates  Analyze and mitigate risks that might affect E2E testing before testing starts  Escalate critical problems  Discuss other common problems and questions E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 45. Киев 2017 Collaboration challenges – cross- teams progress understanding What is it if NO: 1. Scope and activities for end-to-end testing 2. Understanding of the progress end-to-end testing 3. Risks and blockers for end-to-end testing 4. Release readiness dates E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 46. Киев 2017 How to avoid issues? Collaboration challenges – cross- teams progress understanding E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 47. Киев 2017 Regular E2E team Sync Up Participants:  Integration Program Manager  E2E QA Lead  E2E key QA specialists Goals:  Show the progress  Escalate critical problems  Discuss other common problems and questions E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 48. Киев 2017 Example of Daily Progress Visibility E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 49. Киев 2017E2E testing: Challenges and recommendation in test process organization for cross integration teams Example of Daily Progress Visibility
  • 50. Киев 2017 Example of Daily Progress Visibility E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 51. Киев 2017 Collaboration challenges – Summary E2E testing: Challenges and recommendation in test process organization for cross integration teams 1. Regular updates on system updates and readiness were completely clear 2. Risks were identified and mitigated regularly 3. Critical problems were escalated in time 4. Test progress and project health were synchronized between teams
  • 52. Киев 2017E2E testing: Challenges and recommendation in test process organization for cross integration teams Test Team structure
  • 53. Киев 2017 QA Lead - QA Process and Approaches implementation - Cross team ongoing QA work planning and monitoring - Regular QA reporting - People management between teams - Support in building and aligning QA automation approach Manual QAs -Main knowledge keepers in the systems - Responsible for test cases preparation and execution semi- automated procedure - Escalate issues - Define dependencies and quality risks. Inform about them in time Automation QAs - Support in test cases creation - Responsible for incomplete test procedure processing testing - Responsible for test automation implementation - Escalate issues - Define dependencies and quality risks.Inform about them in time Test Team structure - Solution E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 54. Киев 2017 QA Lead QA Manual QA AutomationQA Manager QA Manual Lead QA Manual Lead Middle QA Middle QA Senior QA Middle QA Middle QA Senior QA Senior QA Automation team Test Team structure - Solution Team 1 Team 2 E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 55. Киев 2017 Automation challenges E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 56. Киев 2017 Automation challenges – What was it? 2. Complex and obsolete architecture 1. End-to-end flow is not fully automated 3. Many external and internal dependencies E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 57. Киев 2017 Automation challenges – What was solution? 1. Get access to systems via API to create items 2. Generate required data formats and make to be processed it automatically 3. Automate validation of items in common CRM E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 58. Киев 2017 Automation challenges – Order to automate Smoke Regression Acceptance flows E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 59. Киев 2017 Recommendations 1. Do not change team structure until all important challenges were not clarified 2. Be proactive and look for the solutions 3. Do not try to resolve all issues by yourself 4. Collaborate with stakeholders and systems team members E2E testing: Challenges and recommendation in test process organization for cross integration teams
  • 60. Киев 2017 Questions E2E testing: Challenges and recommendation in test process organization for cross integration teams