SlideShare a Scribd company logo
January 2014 CT R&D Confidential1
Philips CT Automation project
Yaniv Leizer, Itay Krisher, Or Shtark
CT verification
March 2016
January 2014 CT R&D Confidential2
Agenda
• Introduction: Philips & Me & Automation
• IQon Test Automation Project:
• Requirements definition
• Compare alternatives
• Selected solution
• Architecture and process definition (WoW)
• Measurements
• Future backlog
January 2014 CT R&D Confidential3
Who we are ?
• Philips
• Global Company
• More than 120 years old (Since 1891)
• More than 100,000 employees around the globe
• Three main branches: Lightening, Consumer lifestyle, Healthcare
• Competitors: GE, Toshiba, Siemens (..and Samsung)
• Haifa branch: R&D + CT manufacturing factory
January 2014 CT R&D Confidential4
Verification Org
Product
Manager
Development Verification
Manual 1
Manual 2
Automation
System
Engineering
January 2014 CT R&D Confidential5
Our unique Challenges
• We are developing life saving systems
• We are developing Healthcare systems (regulations)
• We are developing embedded complex systems
January 2014 CT R&D Confidential6
Automation Project
WHAT is the solution?
Create automation infrastructure to allow:
• Low maintenance
• Fast and simple for both developers and non-developers
• Integration with existing systems:
• Test Management (ALM)
• Reporting
• Tests reuse for different scenarios (e.g: data driven tests)
• High code standard which complies with Philips standard (design, documentation,
code review)
• Designed, robust architecture that will allow flexibility and scalability in the future
WHY do we need it ?
• Thousands tests to execute per cycle
• Reduce repeating “trivial” tests and allow “creative”
manual tests
• Ability to run tests more often, per multiple platforms,
configurations, by request …
• Full utilization of scanners (nights and weekends)
• Improve our deliverables quality and stability
January 2014 CT R&D Confidential7
First Automation approach
First Automation approach was to create Framework that
will help to build test cases for the non-programmer testers.
Framework contains Building blocks repository and allows to
select BB in order to create the test
January 2014 CT R&D Confidential8
Each building block can get different parameters
First Automation approach
January 2014 CT R&D Confidential9
Problems:
• BB msi (packaging) should be generated before it could
be used for script development
• Very expensive fix turnaround
• Different level of granularity of the BB
• No good classification for the BB in the repository
First Automation approach
January 2014 CT R&D Confidential10
January 2014 CT R&D Confidential11
• Fast development
• Low cost maintenance
• No double code
New Automation Requirements
January 2014 CT R&D Confidential12
Solution
C# Code Based
• Pros
• Low maintenance cost.
• Best user error proof.
• Comfortable orientation for writing tests.
• Object Oriented language (C#).
• Good IDE – Visual Studio.
• Low coupling with external tools (UI recognition tools such as Test
Complete)
• Development “native” language
• Cons
• Less friendly to none coders, but very fast ramp-up to get ability to
develop tests.
January 2014 CT R&D Confidential13
Automation Architecture
January 2014 CT R&D Confidential14
Page Objects
January 2014 CT R&D Confidential15
January 2014 CT R&D Confidential16
January 2014 CT R&D Confidential17
Process Definition
• Follows the flow of the manual test
• Performs exactly same actions on the
product as the manual test
• Creates the same report as manual run
will create
• Takes all the evidences required in the
manual testFor any change in test under
automation, ALM automatically
triggers notification email with
the test name. Automation
team evaluates the change and
decides upon the required
actions needed.
January 2014 CT R&D Confidential18
January 2014 CT R&D Confidential19
• Test that have repeating steps (e.g business component)
• Test that have long execution time(e.g Spectral recon time)
• Test that are exhausting from manual point of view.
• Test that are simple and not requires unique functionality
• Test that have wide parameters coverage.
• Test that provide a good measure of the performance of the system
• Test that provide a good measure of the reliability of the system
Bonus:
Automated test case can perform wider coverage of the system(e.g Test additional
parameters)
What to Automate
January 2014 CT R&D Confidential20
• Short tests(up to 10-15 steps),it will be easier to maintain the test
• Clear, specific instructions in each step ( Wrong example :”All tabs are available”,
”All stages are available”, “use any Exam Card”)
• Clear definition of what is the required evidence for each step (screenshots 
written information)
• Have pre-requisite step that will define the equipment needed for the test.
Lower priority:
• Tests that requires development of unique solution for specific functionality
• Tests that requires small manual run-time.
Automatable Test Design
January 2014 CT R&D Confidential21
• System coverage
• Manual execution time Vs. Automation execution time
• Number of Page Objects and modules that describe the different system’s
components
• Development alignment:
• Check-in tool
• Product build mechanism (Version numbering, ClearCase labeling and
MSI creation)
Measurable Items
January 2014 CT R&D Confidential22
• Image Quality and Applications (Image recognition)
• Execution management tool (run, stop, re-run, debug…)
• Analyzer
• Continuous Integration
• Improved Performance suit
• TDD (Test Driven Development)
Future Backlog
January 2014 CT R&D Confidential23
Project Workflow
January 2014 CT R&D Confidential24

More Related Content

What's hot

" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f..." Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
Lohika_Odessa_TechTalks
 
Agile Testing Vs V
Agile Testing Vs VAgile Testing Vs V
Agile Testing Vs V
Nivetha Padmanaban
 
Introduction to Test Automation
Introduction to Test AutomationIntroduction to Test Automation
Introduction to Test Automation
Pekka Klärck
 
Software product development process
Software product development processSoftware product development process
Software product development process
Sri Kanajan
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
Lee Barnes
 
SCM Transformation Challenges and How to Overcome Them
SCM Transformation Challenges and How to Overcome ThemSCM Transformation Challenges and How to Overcome Them
SCM Transformation Challenges and How to Overcome Them
Compuware
 
Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance Guidelines
Tim Stribos
 
Software testing
Software testingSoftware testing
Software testing
Arvind Verma
 
Agile Testing Vs V
Agile Testing Vs VAgile Testing Vs V
Agile Testing Vs V
Nivetha Padmanaban
 
Chat interfaces for continuous integration - CI/CD Pipeline on Slack
Chat interfaces for continuous integration - CI/CD Pipeline on SlackChat interfaces for continuous integration - CI/CD Pipeline on Slack
Chat interfaces for continuous integration - CI/CD Pipeline on Slack
Troops Engineering
 
Unit testing and code review
Unit testing and code reviewUnit testing and code review
Unit testing and code review
Pavel Grushetzky
 
Software testing and quality assurance
Software testing and quality assuranceSoftware testing and quality assurance
Software testing and quality assurance
Benjamin Baumann
 
QTest
QTest QTest
Overview of Kovair Omnibus Integration Platform
Overview of Kovair Omnibus Integration PlatformOverview of Kovair Omnibus Integration Platform
Overview of Kovair Omnibus Integration Platform
Kovair
 
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
Emerasoft, solutions to collaborate
 
StarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
StarWest2016_T24_ExploratoryAutomation_DawnJardine_FinalStarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
StarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
Dawn Jardine
 
Continuous testing & devops with @petemar5hall
Continuous testing & devops with @petemar5hallContinuous testing & devops with @petemar5hall
Continuous testing & devops with @petemar5hall
Peter Marshall
 
Packaged vs. Custom Application Testing
Packaged vs. Custom Application TestingPackaged vs. Custom Application Testing
Packaged vs. Custom Application Testing
Worksoft
 
Testing
TestingTesting
Testing
Sachin Kainth
 
Combinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification TreesCombinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification Trees
TechWell
 

What's hot (20)

" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f..." Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
 
Agile Testing Vs V
Agile Testing Vs VAgile Testing Vs V
Agile Testing Vs V
 
Introduction to Test Automation
Introduction to Test AutomationIntroduction to Test Automation
Introduction to Test Automation
 
Software product development process
Software product development processSoftware product development process
Software product development process
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
 
SCM Transformation Challenges and How to Overcome Them
SCM Transformation Challenges and How to Overcome ThemSCM Transformation Challenges and How to Overcome Them
SCM Transformation Challenges and How to Overcome Them
 
Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance Guidelines
 
Software testing
Software testingSoftware testing
Software testing
 
Agile Testing Vs V
Agile Testing Vs VAgile Testing Vs V
Agile Testing Vs V
 
Chat interfaces for continuous integration - CI/CD Pipeline on Slack
Chat interfaces for continuous integration - CI/CD Pipeline on SlackChat interfaces for continuous integration - CI/CD Pipeline on Slack
Chat interfaces for continuous integration - CI/CD Pipeline on Slack
 
Unit testing and code review
Unit testing and code reviewUnit testing and code review
Unit testing and code review
 
Software testing and quality assurance
Software testing and quality assuranceSoftware testing and quality assurance
Software testing and quality assurance
 
QTest
QTest QTest
QTest
 
Overview of Kovair Omnibus Integration Platform
Overview of Kovair Omnibus Integration PlatformOverview of Kovair Omnibus Integration Platform
Overview of Kovair Omnibus Integration Platform
 
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
Webinar "Load Testing e Performance Monitoring con NeoLoad e NeoSense"
 
StarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
StarWest2016_T24_ExploratoryAutomation_DawnJardine_FinalStarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
StarWest2016_T24_ExploratoryAutomation_DawnJardine_Final
 
Continuous testing & devops with @petemar5hall
Continuous testing & devops with @petemar5hallContinuous testing & devops with @petemar5hall
Continuous testing & devops with @petemar5hall
 
Packaged vs. Custom Application Testing
Packaged vs. Custom Application TestingPackaged vs. Custom Application Testing
Packaged vs. Custom Application Testing
 
Testing
TestingTesting
Testing
 
Combinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification TreesCombinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification Trees
 

Viewers also liked

Ct pulmonary angiogram (ctpa)
Ct pulmonary angiogram (ctpa)Ct pulmonary angiogram (ctpa)
Ct pulmonary angiogram (ctpa)
VadlamudiNamratha
 
Advances in ct technology
Advances in ct technologyAdvances in ct technology
Advances in ct technology
Mitusha Verma
 
Ct pulmonary angiogram
Ct pulmonary angiogramCt pulmonary angiogram
Ct pulmonary angiogram
muhammed Yasar
 
CT angiography
CT angiographyCT angiography
CT angiography
Jaya Yadav
 
CT Angiography presentation
CT Angiography presentation CT Angiography presentation
CT Angiography presentation
Shatha M
 
Angiography basics
Angiography basicsAngiography basics
Angiography basics
Rad Tech
 
Basics in ct
Basics in ctBasics in ct
Basics in ct
muhammed Yasar
 
Ct angio ppt
Ct angio pptCt angio ppt
Ct angio ppt
drksp
 
Computer Tomography (CT Scan)
Computer Tomography (CT Scan)Computer Tomography (CT Scan)
Computer Tomography (CT Scan)
Likan Patra
 
Ct Basics
Ct BasicsCt Basics
Ct Basics
Pramod Krishnan
 
3 Storytelling Tips - From Acclaimed Writer Burt Helm
3 Storytelling Tips - From Acclaimed Writer Burt Helm3 Storytelling Tips - From Acclaimed Writer Burt Helm
3 Storytelling Tips - From Acclaimed Writer Burt Helm
Ethos3
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
GetSmarter
 
10 Things To Be Thankful For by: @empoweredpres
10 Things To Be Thankful For by: @empoweredpres10 Things To Be Thankful For by: @empoweredpres
10 Things To Be Thankful For by: @empoweredpres
Empowered Presentations
 
BASICS of CT Head
BASICS of CT HeadBASICS of CT Head
BASICS of CT Head
Kunal Mahajan
 
15 Quotes To Nurture Your Creative Soul!
15 Quotes To Nurture Your Creative Soul!15 Quotes To Nurture Your Creative Soul!
15 Quotes To Nurture Your Creative Soul!
DesignMantic
 
How To Win That Next Sales Presentation - @High_Spark @cliffatkinson
How To Win That Next Sales Presentation - @High_Spark @cliffatkinsonHow To Win That Next Sales Presentation - @High_Spark @cliffatkinson
How To Win That Next Sales Presentation - @High_Spark @cliffatkinson
HighSpark | Visual Storytelling Agency
 
Angiography basics and seldinger technique
Angiography basics and seldinger techniqueAngiography basics and seldinger technique
Angiography basics and seldinger technique
Samuel Hernandez
 
The X factor: The Secret to Better Content Marketing
The X factor: The Secret to Better Content Marketing The X factor: The Secret to Better Content Marketing
The X factor: The Secret to Better Content Marketing
Mathew Sweezey
 
10 Better Ways to Add Text to #Images
10 Better Ways to Add Text to #Images 10 Better Ways to Add Text to #Images
10 Better Ways to Add Text to #Images
Presentation Panda
 
Our World is Hungry
Our World is HungryOur World is Hungry
Our World is Hungry
Empowered Presentations
 

Viewers also liked (20)

Ct pulmonary angiogram (ctpa)
Ct pulmonary angiogram (ctpa)Ct pulmonary angiogram (ctpa)
Ct pulmonary angiogram (ctpa)
 
Advances in ct technology
Advances in ct technologyAdvances in ct technology
Advances in ct technology
 
Ct pulmonary angiogram
Ct pulmonary angiogramCt pulmonary angiogram
Ct pulmonary angiogram
 
CT angiography
CT angiographyCT angiography
CT angiography
 
CT Angiography presentation
CT Angiography presentation CT Angiography presentation
CT Angiography presentation
 
Angiography basics
Angiography basicsAngiography basics
Angiography basics
 
Basics in ct
Basics in ctBasics in ct
Basics in ct
 
Ct angio ppt
Ct angio pptCt angio ppt
Ct angio ppt
 
Computer Tomography (CT Scan)
Computer Tomography (CT Scan)Computer Tomography (CT Scan)
Computer Tomography (CT Scan)
 
Ct Basics
Ct BasicsCt Basics
Ct Basics
 
3 Storytelling Tips - From Acclaimed Writer Burt Helm
3 Storytelling Tips - From Acclaimed Writer Burt Helm3 Storytelling Tips - From Acclaimed Writer Burt Helm
3 Storytelling Tips - From Acclaimed Writer Burt Helm
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
10 Things To Be Thankful For by: @empoweredpres
10 Things To Be Thankful For by: @empoweredpres10 Things To Be Thankful For by: @empoweredpres
10 Things To Be Thankful For by: @empoweredpres
 
BASICS of CT Head
BASICS of CT HeadBASICS of CT Head
BASICS of CT Head
 
15 Quotes To Nurture Your Creative Soul!
15 Quotes To Nurture Your Creative Soul!15 Quotes To Nurture Your Creative Soul!
15 Quotes To Nurture Your Creative Soul!
 
How To Win That Next Sales Presentation - @High_Spark @cliffatkinson
How To Win That Next Sales Presentation - @High_Spark @cliffatkinsonHow To Win That Next Sales Presentation - @High_Spark @cliffatkinson
How To Win That Next Sales Presentation - @High_Spark @cliffatkinson
 
Angiography basics and seldinger technique
Angiography basics and seldinger techniqueAngiography basics and seldinger technique
Angiography basics and seldinger technique
 
The X factor: The Secret to Better Content Marketing
The X factor: The Secret to Better Content Marketing The X factor: The Secret to Better Content Marketing
The X factor: The Secret to Better Content Marketing
 
10 Better Ways to Add Text to #Images
10 Better Ways to Add Text to #Images 10 Better Ways to Add Text to #Images
10 Better Ways to Add Text to #Images
 
Our World is Hungry
Our World is HungryOur World is Hungry
Our World is Hungry
 

Similar to Automation at Philips Healthcare

Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
Codecamp Romania
 
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
Vimal Suba
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 
Questions for successful test automation projects
Questions for successful test automation projectsQuestions for successful test automation projects
Questions for successful test automation projects
Daniel Ionita
 
Continuous integration practices to improve the software quality
Continuous integration practices to improve the software qualityContinuous integration practices to improve the software quality
Continuous integration practices to improve the software quality
Fabricio Epaminondas
 
Continuous Integration Practices
Continuous Integration Practices Continuous Integration Practices
Continuous Integration Practices
Marcelo Freire
 
CI/CD Overview
CI/CD OverviewCI/CD Overview
CI/CD Overview
An Nguyen
 
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
TEST Huddle
 
Continuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at DashlaneContinuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at Dashlane
Dashlane
 
New trends in testing automation
New trends in testing automationNew trends in testing automation
New trends in testing automation
Eran Kinsbrunner
 
Aligning Software Testing With Modern Age Development Practices
Aligning Software Testing With Modern Age Development PracticesAligning Software Testing With Modern Age Development Practices
Aligning Software Testing With Modern Age Development Practices
Aspire Systems
 
RubyDay-Turin13_Nov_15
RubyDay-Turin13_Nov_15RubyDay-Turin13_Nov_15
RubyDay-Turin13_Nov_15
Pierluigi Riti
 
CI-CD and DevOps with Ruby
CI-CD and DevOps with RubyCI-CD and DevOps with Ruby
CI-CD and DevOps with Ruby
Pierluigi Riti
 
from 0 to continuous delivery in 30 minutes
from 0 to continuous delivery in 30 minutesfrom 0 to continuous delivery in 30 minutes
from 0 to continuous delivery in 30 minutes
AgileSparks
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
TechWell
 
Software development life cycle
Software development life cycleSoftware development life cycle
Software development life cycle
Manindra Simhadri
 
Forward5 Auxis VMware
Forward5 Auxis VMwareForward5 Auxis VMware
Forward5 Auxis VMware
Auxis Consulting & Outsourcing
 
Qtp - Introduction values
Qtp - Introduction valuesQtp - Introduction values
Qtp - Introduction values
Vibrant Technologies & Computers
 
Putting Quality First through Continuous Testing
Putting Quality First through Continuous TestingPutting Quality First through Continuous Testing
Putting Quality First through Continuous Testing
TechWell
 
Training Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptxTraining Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptx
Nashet Ali
 

Similar to Automation at Philips Healthcare (20)

Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
Iasi code camp 20 april 2013 marian chicu - database unit tests in the sql se...
 
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
Cloud and Network Transformation using DevOps methodology : Cisco Live 2015
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Questions for successful test automation projects
Questions for successful test automation projectsQuestions for successful test automation projects
Questions for successful test automation projects
 
Continuous integration practices to improve the software quality
Continuous integration practices to improve the software qualityContinuous integration practices to improve the software quality
Continuous integration practices to improve the software quality
 
Continuous Integration Practices
Continuous Integration Practices Continuous Integration Practices
Continuous Integration Practices
 
CI/CD Overview
CI/CD OverviewCI/CD Overview
CI/CD Overview
 
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
 
Continuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at DashlaneContinuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at Dashlane
 
New trends in testing automation
New trends in testing automationNew trends in testing automation
New trends in testing automation
 
Aligning Software Testing With Modern Age Development Practices
Aligning Software Testing With Modern Age Development PracticesAligning Software Testing With Modern Age Development Practices
Aligning Software Testing With Modern Age Development Practices
 
RubyDay-Turin13_Nov_15
RubyDay-Turin13_Nov_15RubyDay-Turin13_Nov_15
RubyDay-Turin13_Nov_15
 
CI-CD and DevOps with Ruby
CI-CD and DevOps with RubyCI-CD and DevOps with Ruby
CI-CD and DevOps with Ruby
 
from 0 to continuous delivery in 30 minutes
from 0 to continuous delivery in 30 minutesfrom 0 to continuous delivery in 30 minutes
from 0 to continuous delivery in 30 minutes
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
 
Software development life cycle
Software development life cycleSoftware development life cycle
Software development life cycle
 
Forward5 Auxis VMware
Forward5 Auxis VMwareForward5 Auxis VMware
Forward5 Auxis VMware
 
Qtp - Introduction values
Qtp - Introduction valuesQtp - Introduction values
Qtp - Introduction values
 
Putting Quality First through Continuous Testing
Putting Quality First through Continuous TestingPutting Quality First through Continuous Testing
Putting Quality First through Continuous Testing
 
Training Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptxTraining Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptx
 

More from Arnon Axelrod

Defect free development - QS Tag2019
Defect free development - QS Tag2019Defect free development - QS Tag2019
Defect free development - QS Tag2019
Arnon Axelrod
 
ATDD open house
ATDD open houseATDD open house
ATDD open house
Arnon Axelrod
 
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
Arnon Axelrod
 
Competitive code
Competitive codeCompetitive code
Competitive code
Arnon Axelrod
 
Effective refactoring
Effective refactoringEffective refactoring
Effective refactoring
Arnon Axelrod
 
Beyond pageobjects
Beyond pageobjectsBeyond pageobjects
Beyond pageobjects
Arnon Axelrod
 
Test automation and architecture
Test automation and architectureTest automation and architecture
Test automation and architecture
Arnon Axelrod
 
Unit Testing, TDD and ATDD
Unit Testing, TDD and ATDDUnit Testing, TDD and ATDD
Unit Testing, TDD and ATDD
Arnon Axelrod
 
Software quality - no more bugs!
Software quality - no more bugs!Software quality - no more bugs!
Software quality - no more bugs!
Arnon Axelrod
 
C# in depth
C# in depthC# in depth
C# in depth
Arnon Axelrod
 
ATDD with SpecFlow
ATDD with SpecFlowATDD with SpecFlow
ATDD with SpecFlow
Arnon Axelrod
 

More from Arnon Axelrod (11)

Defect free development - QS Tag2019
Defect free development - QS Tag2019Defect free development - QS Tag2019
Defect free development - QS Tag2019
 
ATDD open house
ATDD open houseATDD open house
ATDD open house
 
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
Test Automation Maturity Model (Israel Test Automation meetup 12/11/2018)
 
Competitive code
Competitive codeCompetitive code
Competitive code
 
Effective refactoring
Effective refactoringEffective refactoring
Effective refactoring
 
Beyond pageobjects
Beyond pageobjectsBeyond pageobjects
Beyond pageobjects
 
Test automation and architecture
Test automation and architectureTest automation and architecture
Test automation and architecture
 
Unit Testing, TDD and ATDD
Unit Testing, TDD and ATDDUnit Testing, TDD and ATDD
Unit Testing, TDD and ATDD
 
Software quality - no more bugs!
Software quality - no more bugs!Software quality - no more bugs!
Software quality - no more bugs!
 
C# in depth
C# in depthC# in depth
C# in depth
 
ATDD with SpecFlow
ATDD with SpecFlowATDD with SpecFlow
ATDD with SpecFlow
 

Recently uploaded

Using Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query PerformanceUsing Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query Performance
Grant Fritchey
 
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
safelyiotech
 
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
XfilesPro
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
kgyxske
 
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
ToXSL Technologies
 
UI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design SystemUI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design System
Peter Muessig
 
ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.
Maitrey Patel
 
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
kalichargn70th171
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
Peter Muessig
 
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLESINTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
anfaltahir1010
 
Energy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina JonuziEnergy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina Jonuzi
Green Software Development
 
Measures in SQL (SIGMOD 2024, Santiago, Chile)
Measures in SQL (SIGMOD 2024, Santiago, Chile)Measures in SQL (SIGMOD 2024, Santiago, Chile)
Measures in SQL (SIGMOD 2024, Santiago, Chile)
Julian Hyde
 
All you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVMAll you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVM
Alina Yurenko
 
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesE-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Quickdice ERP
 
Unveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdfUnveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdf
brainerhub1
 
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
kalichargn70th171
 
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSISDECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
Tier1 app
 
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdfTop Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
VALiNTRY360
 
Project Management: The Role of Project Dashboards.pdf
Project Management: The Role of Project Dashboards.pdfProject Management: The Role of Project Dashboards.pdf
Project Management: The Role of Project Dashboards.pdf
Karya Keeper
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
Severalnines
 

Recently uploaded (20)

Using Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query PerformanceUsing Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query Performance
 
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
 
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
 
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
 
UI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design SystemUI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design System
 
ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.
 
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
 
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLESINTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLES
 
Energy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina JonuziEnergy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina Jonuzi
 
Measures in SQL (SIGMOD 2024, Santiago, Chile)
Measures in SQL (SIGMOD 2024, Santiago, Chile)Measures in SQL (SIGMOD 2024, Santiago, Chile)
Measures in SQL (SIGMOD 2024, Santiago, Chile)
 
All you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVMAll you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVM
 
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesE-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
 
Unveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdfUnveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdf
 
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...
 
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSISDECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
 
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdfTop Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf
 
Project Management: The Role of Project Dashboards.pdf
Project Management: The Role of Project Dashboards.pdfProject Management: The Role of Project Dashboards.pdf
Project Management: The Role of Project Dashboards.pdf
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
 

Automation at Philips Healthcare

  • 1. January 2014 CT R&D Confidential1 Philips CT Automation project Yaniv Leizer, Itay Krisher, Or Shtark CT verification March 2016
  • 2. January 2014 CT R&D Confidential2 Agenda • Introduction: Philips & Me & Automation • IQon Test Automation Project: • Requirements definition • Compare alternatives • Selected solution • Architecture and process definition (WoW) • Measurements • Future backlog
  • 3. January 2014 CT R&D Confidential3 Who we are ? • Philips • Global Company • More than 120 years old (Since 1891) • More than 100,000 employees around the globe • Three main branches: Lightening, Consumer lifestyle, Healthcare • Competitors: GE, Toshiba, Siemens (..and Samsung) • Haifa branch: R&D + CT manufacturing factory
  • 4. January 2014 CT R&D Confidential4 Verification Org Product Manager Development Verification Manual 1 Manual 2 Automation System Engineering
  • 5. January 2014 CT R&D Confidential5 Our unique Challenges • We are developing life saving systems • We are developing Healthcare systems (regulations) • We are developing embedded complex systems
  • 6. January 2014 CT R&D Confidential6 Automation Project WHAT is the solution? Create automation infrastructure to allow: • Low maintenance • Fast and simple for both developers and non-developers • Integration with existing systems: • Test Management (ALM) • Reporting • Tests reuse for different scenarios (e.g: data driven tests) • High code standard which complies with Philips standard (design, documentation, code review) • Designed, robust architecture that will allow flexibility and scalability in the future WHY do we need it ? • Thousands tests to execute per cycle • Reduce repeating “trivial” tests and allow “creative” manual tests • Ability to run tests more often, per multiple platforms, configurations, by request … • Full utilization of scanners (nights and weekends) • Improve our deliverables quality and stability
  • 7. January 2014 CT R&D Confidential7 First Automation approach First Automation approach was to create Framework that will help to build test cases for the non-programmer testers. Framework contains Building blocks repository and allows to select BB in order to create the test
  • 8. January 2014 CT R&D Confidential8 Each building block can get different parameters First Automation approach
  • 9. January 2014 CT R&D Confidential9 Problems: • BB msi (packaging) should be generated before it could be used for script development • Very expensive fix turnaround • Different level of granularity of the BB • No good classification for the BB in the repository First Automation approach
  • 10. January 2014 CT R&D Confidential10
  • 11. January 2014 CT R&D Confidential11 • Fast development • Low cost maintenance • No double code New Automation Requirements
  • 12. January 2014 CT R&D Confidential12 Solution C# Code Based • Pros • Low maintenance cost. • Best user error proof. • Comfortable orientation for writing tests. • Object Oriented language (C#). • Good IDE – Visual Studio. • Low coupling with external tools (UI recognition tools such as Test Complete) • Development “native” language • Cons • Less friendly to none coders, but very fast ramp-up to get ability to develop tests.
  • 13. January 2014 CT R&D Confidential13 Automation Architecture
  • 14. January 2014 CT R&D Confidential14 Page Objects
  • 15. January 2014 CT R&D Confidential15
  • 16. January 2014 CT R&D Confidential16
  • 17. January 2014 CT R&D Confidential17 Process Definition • Follows the flow of the manual test • Performs exactly same actions on the product as the manual test • Creates the same report as manual run will create • Takes all the evidences required in the manual testFor any change in test under automation, ALM automatically triggers notification email with the test name. Automation team evaluates the change and decides upon the required actions needed.
  • 18. January 2014 CT R&D Confidential18
  • 19. January 2014 CT R&D Confidential19 • Test that have repeating steps (e.g business component) • Test that have long execution time(e.g Spectral recon time) • Test that are exhausting from manual point of view. • Test that are simple and not requires unique functionality • Test that have wide parameters coverage. • Test that provide a good measure of the performance of the system • Test that provide a good measure of the reliability of the system Bonus: Automated test case can perform wider coverage of the system(e.g Test additional parameters) What to Automate
  • 20. January 2014 CT R&D Confidential20 • Short tests(up to 10-15 steps),it will be easier to maintain the test • Clear, specific instructions in each step ( Wrong example :”All tabs are available”, ”All stages are available”, “use any Exam Card”) • Clear definition of what is the required evidence for each step (screenshots written information) • Have pre-requisite step that will define the equipment needed for the test. Lower priority: • Tests that requires development of unique solution for specific functionality • Tests that requires small manual run-time. Automatable Test Design
  • 21. January 2014 CT R&D Confidential21 • System coverage • Manual execution time Vs. Automation execution time • Number of Page Objects and modules that describe the different system’s components • Development alignment: • Check-in tool • Product build mechanism (Version numbering, ClearCase labeling and MSI creation) Measurable Items
  • 22. January 2014 CT R&D Confidential22 • Image Quality and Applications (Image recognition) • Execution management tool (run, stop, re-run, debug…) • Analyzer • Continuous Integration • Improved Performance suit • TDD (Test Driven Development) Future Backlog
  • 23. January 2014 CT R&D Confidential23 Project Workflow
  • 24. January 2014 CT R&D Confidential24