SlideShare a Scribd company logo
TG
AM Tutorial
4/30/13 8:30AM

Test Management for Cloud-based
Applications
Presented by:
Ruud Teunissen
Polteq Test Services BV

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Ruud Teunissen
An international test consultant at Polteq Test Services BV, Ruud Teunissen has performed several test
functions in a number of IT projects: tester, test specialist, test consultant, and test manager. Ruud
participated in the development of the structured testing methodology TMap®—Test Management
Approach. Together with Martin Pol and Erik van Veenendaal, Ruud is coauthor of several books on
structured testing, including Software Testing: A Guide to the TMap® Approach.
Test Management for
Cloud Based Applications
Ruud Teunissen
Polteq Test Services BV
The Netherlands

1
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
analyzing, transmitting, learning, controlling,
purchasing, testing, alarming, changing, updating,
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
mailing, communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching, saving,
accelerating, enhancing, creating, growing, checking
in, checking out, finding out, reaching, denying,
talking, designing, making, verifying, measuring

Develop and Test

Operate and Manage

Email
Surf
Transfer

Store

4

2
Develop and Test

Email
Surf
Transfer

redundancy, proliferation

limitations

80% unused

storage claim

environmentally unfriendly

Operate and Manage

Store

5

Develop and Test

Email
Surf
Transfer

SOA

internet technology

virtualization

standard software

Operate and Manage

bandwidth

Store

6

3
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
Develop and transmitting, learning, controlling,
Email
analyzing, Test
Surf
purchasing, testing, alarming, changing, updating,
Transfer
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
mailing, communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching, saving,
Operate and Manage
accelerating, enhancing, creating, growing,Store
checking
in, checking out, finding out, reaching, denying,
talking, designing, making, verifying, measuring
7

4
Question

Please list your top 5 reasons
why you are moving to the
cloud

9

Top 5 Reasons

1

2

3

4

5
10

5
Essential characteristics
On-demand service
Self service provisioning, pay-per-use
No human interaction

US: National Institute of Standards and Technology
http://www.nist.gov

Essential characteristics
On-demand service
Broad network access
Standard mechanisms over networks
“Any” client

US: National Institute of Standards and Technology
http://www.nist.gov

6
Essential characteristics
On-demand service
Broad network access
Resource pooling
Multi-tenant
Storage, processing, memory, virtual machines, …
Location independent

US: National Institute of Standards and Technology
http://www.nist.gov

Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Rapid scale in and out
“Any quantity” at any time

US: National Institute of Standards and Technology
http://www.nist.gov

7
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service
Controlled resource use
Transparency, pay-per-use

US: National Institute of Standards and Technology
http://www.nist.gov

Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service

Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models
Software as a Service
Platform as a Service
Infrastructure as a Service

US: National Institute of Standards and Technology
http://www.nist.gov

8
Question

What is being moved into the
cloud?

17

Pack List

1

2

3

4

5
18

9
What is “done” in the cloud?
<500, SME

>500

Consumer

Public

Private
Hybride
Community

Public

*aaS

IaaS, PaaS, DaaS, SaaS

SaaS

Taas
*aaS
Mail
Storage
Infrastructure
CRM
Finance
Business processes
19

Data Centre
Data Management
Business processes

Surf and mail
Apps
Social media
Dropbox
Google services
Spotify
Picasa
Games
……………

Question – Group Discussion

Please list your top 5 cloud
related risks when you are
moving to the cloud

20

10
Top 5 Risks

1

2

3

4

5
21

Standards

Cyber crime

Continuity

Privacy

Legislation

Multi platform

Impact organisation
143

11
Performance

Security

Availability & Continuity

Functionality

Risks

Manageability

23

Legislation & Regulations

Suppliers & Outsourcing

Performance

Security

YOUR
Operational Profile

Availability & Continuity

Functionality

Other customers

Risks

Manageability

24

Legislation & Regulations

Suppliers & Outsourcing

YOUR
Operational Profile
PLUS

12
Performance

Security

The idea:
“it’s safe”

Availability & Continuity

Functionality

Everything over the web

Risks

Manageability

25

Legislation & Regulations
Home ground for
hackers
Suppliers & Outsourcing

Performance

Security

No free choice of
device.

Availability & Continuity

Functionality

Bring Your Own Device

Risks

Manageability

26

Legislation & Regulations
Endless
possibilities.
Suppliers & Outsourcing

13
Performance
Taken care of.
Security

Availability & Continuity

Functionality

Backup and recovery

Risks

Manageability

27

Legislation & Regulations
Who will support
me?
Suppliers & Outsourcing

Performance

Security

Planned and
controlled

Availability & Continuity

Functionality

Updates, patches, fixes,

Risks

Manageability

28

Legislation & Regulations
Do I have a
choice?
Suppliers & Outsourcing

14
Performance
In house.
Security

Availability & Continuity

Functionality

Where is my data?
And is that OK?

Risks

Manageability

29

Legislation & Regulations
Somewhere
Suppliers & Outsourcing

Performance

Security

Availability & Continuity

Functionality

Risks

Manageability

30

Legislation & Regulations

Suppliers & Outsourcing

15
Question – Group Session

Let’s look at the clustered risks
What test measures would you
consider applying?
31

Test Measures

1

2

3

4

5
32

16
Testing?

Interview
Check
Trial
Proof of concept

Intake

33

Performance Testing
Security Testing
Manageability Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Interview
Proof ofProef
concept
Testen
Intake

Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations

34

Testing in Production

17
Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

35

Legislation & Regulations

Suppliers & Outsourcing

Testing in Production

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Testing caused by
Legislation & Regulations

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

36

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

18
Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

37

Legislation & Regulations

Suppliers & Outsourcing

Testing in Production

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity

Manageability Testing
Architecture

Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Testing caused by
Legislation & Regulations

Availability & Continuity
Testing

Risks

From “individual” risks
Functional Testing
to
Manageability
“individual” test measures
Migration Testing

38

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

19
Performance Testing

Selection

Security Testing
Manageability Testing

Implementation

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing

Production

Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production

39

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

40

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

20
Performance Testing
Security Testing
Manageability Testing

Selection Criteria

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations

41

Testing in Production

Question – Group Session

What criteria will you put on
your list?

42

21
Knock Out List

1

2

3

4

5
43

“Inspiration List”
CRITERION
PRIO
Functional
Do the service and the specific business processes align?
Does the service fit well in the E2E business process?
Is the service sufficiently adaptable to specific requirements?
Are many adjustments needed?
Is customization possible
Is (a lot of) customization needed?
Are the required platforms supported?
Are “het nieuwe werken” and BYOD supported sufficiently?
Is it possible to connect / integrate the service with the other
systems?
Are sufficient manuals and/or courses available?
Implementation
Is the impact on current activities acceptable?
Is a feasible route for migration towards the service
available?
44

22
“Inspiration List”
CRITERION
PRIO
Support
Are changes in the service announced beforehand?
Are sufficient test facilities available around the service (test
environment, test tooling, testware, access to infrastructure,
…)?
Are there sufficient support facilities?
Is it clear how incidents can be reported?
Are incidents resolved fast enough?
Performance
Are response times low enough?
Is the number of possible simultaneous users high enough?
Is bandwidth sufficient?
Is sufficient potential for growth available?
Is the actual use charged correctly?

45

“Inspiration List”
CRITERION
PRIO
Security
Are adequate authorization and authentication possibilities in
place?
Is the physical security of the service locations sufficient?
Is the support access security of the service sufficient?
Is mutual access security between customers sufficient?
Are data changes traceable?
Is data storage for the service reliable?
Is deleting data in the service reliable?
Is security of the connection to the service sufficient?
Are security options for the customer sufficient?
Does the supplier have security certificates? (for example
SAS 70 type II)?
Availability
Is the level of availability for the service sufficient?
Are back-up / fail-over / disaster-recovery provisions
sufficient?
46

23
“Inspiration List”
CRITERION
PRIO
Law and regulations
Does the data location comply to all legal requirements?
Does the data processing comply to all legal requirements?
Do the terms contain parts that are conflicting to the duties
of the customer?
Supplier
Is clear what happens when the contract ends, or in case of
bankruptcy or conflict?
Is a good helpdesk available?
Does the supplier have experience in:
- Offering this particular service?
- Offering services in general?
- Developing services?
- The customer’s field?
- Developing, testing and supporting services (know how)?
Do methods used by supplier align with those of the
customer (if relevant)?
47

“Inspiration List”
CRITERION
Supplier
Is quality assurance arranged?
Is the supplier ahead in its field?
Is the size of the supplier in accordance with the
expectations of the customer?
Does the supplier have a good reputation (are there
references)?
Is providing services the core business of the supplier?
Does the supplier have opportunities for future expansion?
Does the supplier speak the same language?
Is transparency and flexibility of the supplier sufficient?

PRIO

48

24
Performance Testing
Security Testing
Manageability Testing

Proof of Concept

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production

49

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

50

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

25
Performance Testing
Security Testing

Known measures
tuned and tweaked

Manageability Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing

New measures developed
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production

51

YOUR
Operational Profile

Performance Testing
Security Testing
Manageability Testing

Load Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing

YOUR
Operational Profile
PLUS
ACTUAL MOMENT
52

Testing caused by
Legislation & Regulations
Testing in Production

26
Performance Testing
Security Testing
Manageability Testing

Online – Offline

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing

Use case testing.
Global testing.
53

Testing caused by
Legislation & Regulations
Testing in Production

Multiplatform
testing.

Performance Testing
Security Testing
Manageability Testing

Any device – any platform

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing

Multiplatform
testing.
54

Testing caused by
Legislation & Regulations
Testing in Production

27
Internet Explorer 6

Windows XP

Internet Explorer 7

Windows Vista

Internet Explorer 8
Windows 7

Firefox 3.5

Windows 2003 server

Firefox 3.6
Browsers

Windows 8

Firefox 4
Safari 4

Windows CE

Safari 5
Linux

Operating Systems

Chrome11

Unix

Opera11

Multiplatform

Mac OS Lion

PC

Mac OS Snowleopard

SUN
Computer

iOS

Macintosh

Android

iPhone ..

Windows Mobile

Samsung
Devices

NOKIA

Mobile

Xxx
ASUS..
Blackberry
Tablet

MOTOROLA
Xxx

55

Multiplatform
testing.

Performance Testing
Security Testing
Manageability Testing

Any device – any platform

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing

Multiplatform
testing.
56

Testing caused by
Legislation & Regulations
Testing in Production

28
Incidental testing.

Performance Testing
Security Testing

Legislation + Regulations
=
Test basis

Manageability Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations

Compliancy testing.
Testing in Production

57

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing
Functional Testing

Manageability

Risks

Migration Testing

58

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

29
Performance Testing

Continuous
End-to-End Test

Security Testing
Manageability Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Testing during Selection

Availability & Continuity
Testing

Functionals
and
non-functionals

Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations

59

Testing in Production

Question – Group Session

What would you like to
(continue) test(ing) in
production?
And why?
60

30
Testing in production

1

2

3

4

5
61

Testing in production?
• Continuity in case of
–
–
–
–
–
–

changes
changes
growth
changes
changes
changes

in the service
at the supplier
in the business process
in connected resources
in the internet

• Measuring guarantees
– Avalaibility
– Scalability

- Performance
- Security

• Evaluate original selection criteria
62

31
Production - Continuous End-to-End test
• Mechanism for Detection
– Important in an ever changing world

• Functionals and non-functionals

63

Standards

Cyber crime

Check
Continuity

Interview
Privacy

Legislation

Proof of concept

Trial

Multi platform

Intake
Impact organisation

32
Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability
Test starts earlier & Continuity
Testing
Test scope is widened
Test will never Functional Testing
stop
Manageability
Functionality

Risks

Migration Testing

65

Legislation & Regulations

Suppliers & Outsourcing

Testing in Production

Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Testing caused by
Legislation & Regulations

Availability & Continuity
Testing

Questions?

Functional Testing
Manageability

Risks

Migration Testing

66

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

33
Testing during Selection
Performance Testing

Security
Security Testing
Availability & Continuity
Manageability Testing
Functionality

Te s t M e a s u r e s
Te s t M e a s u r e s

Performance

Availability & Continuity
Testing

Thank you!

Functional Testing
Manageability

Risks

Migration Testing

67

Legislation & Regulations

Suppliers & Outsourcing

Testing caused by
Legislation & Regulations
Testing in Production

About the speaker
Ruud Teunissen
Polteq Test Services, The Netherlands
ruud.teunissen@polteq.com - http://www.polteq.com
In the testing world since 1989, Ruud Teunissen has held
numerous test functions in different organizations and
projects: tester, test specialist, test consultant, test manager,
etcetera. Ruud is co-author of several books on software
testing and is a frequent speaker at (inter)national
conferences and workshops. He was a member of the
program committee for Quality Week Europe and EuroSTAR.
Ruud is currently Senior Test Consultant at Polteq Test
Services BV and responsible for the quality of Polteq
services and assignments.

68

34

More Related Content

What's hot

Legal Liability for IOT Cybersecurity Vulnerabilities
Legal Liability for IOT Cybersecurity VulnerabilitiesLegal Liability for IOT Cybersecurity Vulnerabilities
Legal Liability for IOT Cybersecurity Vulnerabilities
Priyanka Aash
 
Information Security Assessment Offering
Information Security Assessment OfferingInformation Security Assessment Offering
Information Security Assessment Offering
eeaches
 
Protecting endpoints from targeted attacks
Protecting endpoints from targeted attacksProtecting endpoints from targeted attacks
Protecting endpoints from targeted attacks
AppSense
 
Equifax, the FTC Act, and Vulnerability Scanning
Equifax, the FTC Act, and Vulnerability ScanningEquifax, the FTC Act, and Vulnerability Scanning
Equifax, the FTC Act, and Vulnerability Scanning
Black Duck by Synopsys
 
New Security Legislation & It's Implications for OSS Management
New Security Legislation & It's Implications for OSS Management New Security Legislation & It's Implications for OSS Management
New Security Legislation & It's Implications for OSS Management
Black Duck by Synopsys
 
Ruben Melendez - Economically Justifying IT Security Initiatives
Ruben Melendez - Economically Justifying IT Security InitiativesRuben Melendez - Economically Justifying IT Security Initiatives
Ruben Melendez - Economically Justifying IT Security Initiatives
centralohioissa
 
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
Denim Group
 
InDefend-Integrated Data Privacy Offerings
InDefend-Integrated Data Privacy Offerings  InDefend-Integrated Data Privacy Offerings
InDefend-Integrated Data Privacy Offerings
Data Resolve Technologies Pvt. Ltd.
 

What's hot (9)

Legal Liability for IOT Cybersecurity Vulnerabilities
Legal Liability for IOT Cybersecurity VulnerabilitiesLegal Liability for IOT Cybersecurity Vulnerabilities
Legal Liability for IOT Cybersecurity Vulnerabilities
 
Information Security Assessment Offering
Information Security Assessment OfferingInformation Security Assessment Offering
Information Security Assessment Offering
 
Protecting endpoints from targeted attacks
Protecting endpoints from targeted attacksProtecting endpoints from targeted attacks
Protecting endpoints from targeted attacks
 
Equifax, the FTC Act, and Vulnerability Scanning
Equifax, the FTC Act, and Vulnerability ScanningEquifax, the FTC Act, and Vulnerability Scanning
Equifax, the FTC Act, and Vulnerability Scanning
 
New Security Legislation & It's Implications for OSS Management
New Security Legislation & It's Implications for OSS Management New Security Legislation & It's Implications for OSS Management
New Security Legislation & It's Implications for OSS Management
 
Eng Solutions - Capability Statement-Latest
Eng Solutions - Capability Statement-LatestEng Solutions - Capability Statement-Latest
Eng Solutions - Capability Statement-Latest
 
Ruben Melendez - Economically Justifying IT Security Initiatives
Ruben Melendez - Economically Justifying IT Security InitiativesRuben Melendez - Economically Justifying IT Security Initiatives
Ruben Melendez - Economically Justifying IT Security Initiatives
 
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
Giving your AppSec program the edge - using OpenSAMM for benchmarking and sof...
 
InDefend-Integrated Data Privacy Offerings
InDefend-Integrated Data Privacy Offerings  InDefend-Integrated Data Privacy Offerings
InDefend-Integrated Data Privacy Offerings
 

Viewers also liked

Management Issues in Test Automation
Management Issues in Test AutomationManagement Issues in Test Automation
Management Issues in Test Automation
TechWell
 
Collaboration without Chaos
Collaboration without ChaosCollaboration without Chaos
Collaboration without Chaos
TechWell
 
Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!
TechWell
 
It’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester CreativityIt’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester Creativity
TechWell
 
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development TeamsMake the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
TechWell
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
TechWell
 
Build Your Mobile Testing Knowledge
Build Your Mobile Testing KnowledgeBuild Your Mobile Testing Knowledge
Build Your Mobile Testing Knowledge
TechWell
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
TechWell
 
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the UglyAgile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
TechWell
 
Risk-based Testing: Not for the Fainthearted
Risk-based Testing: Not for the FaintheartedRisk-based Testing: Not for the Fainthearted
Risk-based Testing: Not for the Fainthearted
TechWell
 
Connecting with Customers
Connecting with CustomersConnecting with Customers
Connecting with Customers
TechWell
 
Creating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and TechniquesCreating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and Techniques
TechWell
 
Building Successful Test Teams
Building Successful Test TeamsBuilding Successful Test Teams
Building Successful Test Teams
TechWell
 
Adaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise AgilityAdaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise Agility
TechWell
 
Designing Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web ApplicationsDesigning Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web Applications
TechWell
 
Data Collection and Analysis for Better Requirements
Data Collection and Analysis for Better RequirementsData Collection and Analysis for Better Requirements
Data Collection and Analysis for Better Requirements
TechWell
 
Cause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case DesignCause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case Design
TechWell
 
Six Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile SuccessSix Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile Success
TechWell
 

Viewers also liked (18)

Management Issues in Test Automation
Management Issues in Test AutomationManagement Issues in Test Automation
Management Issues in Test Automation
 
Collaboration without Chaos
Collaboration without ChaosCollaboration without Chaos
Collaboration without Chaos
 
Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!
 
It’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester CreativityIt’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester Creativity
 
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development TeamsMake the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
 
Build Your Mobile Testing Knowledge
Build Your Mobile Testing KnowledgeBuild Your Mobile Testing Knowledge
Build Your Mobile Testing Knowledge
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
 
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the UglyAgile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
 
Risk-based Testing: Not for the Fainthearted
Risk-based Testing: Not for the FaintheartedRisk-based Testing: Not for the Fainthearted
Risk-based Testing: Not for the Fainthearted
 
Connecting with Customers
Connecting with CustomersConnecting with Customers
Connecting with Customers
 
Creating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and TechniquesCreating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and Techniques
 
Building Successful Test Teams
Building Successful Test TeamsBuilding Successful Test Teams
Building Successful Test Teams
 
Adaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise AgilityAdaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise Agility
 
Designing Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web ApplicationsDesigning Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web Applications
 
Data Collection and Analysis for Better Requirements
Data Collection and Analysis for Better RequirementsData Collection and Analysis for Better Requirements
Data Collection and Analysis for Better Requirements
 
Cause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case DesignCause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case Design
 
Six Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile SuccessSix Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile Success
 

Similar to Test Management for Cloud-based Applications

Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
TEST Huddle
 
Testing Cloud Services - Kees Blokland and Jeroen Mengerink
Testing Cloud Services - Kees Blokland and Jeroen MengerinkTesting Cloud Services - Kees Blokland and Jeroen Mengerink
Testing Cloud Services - Kees Blokland and Jeroen Mengerink
Kees Blokland
 
Going Cloudy? How to test SaaS? with Kees Blokland
Going Cloudy? How to test SaaS? with Kees Blokland Going Cloudy? How to test SaaS? with Kees Blokland
Going Cloudy? How to test SaaS? with Kees Blokland
TEST Huddle
 
EuroStar Webinar Testing Cloud Services Kees Blokland
EuroStar Webinar Testing Cloud Services Kees BloklandEuroStar Webinar Testing Cloud Services Kees Blokland
EuroStar Webinar Testing Cloud Services Kees Blokland
Kees Blokland
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Kees Blokland
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
TEST Huddle
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing.
Deepak Daniel
 
Cloud Clinique Enterprise IT Certification Program - Module Matrix
Cloud Clinique   Enterprise IT Certification Program - Module MatrixCloud Clinique   Enterprise IT Certification Program - Module Matrix
Cloud Clinique Enterprise IT Certification Program - Module Matrix
Adrian Hall
 
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
TEST Huddle
 
Company Profile
Company ProfileCompany Profile
Company Profile3SC World
 
Cyber review-guide
Cyber review-guideCyber review-guide
Cyber review-guide
aqazad
 
Mark Sage (AREA): Fulfilling the Potential of AR for Enterprise
Mark Sage (AREA): Fulfilling the Potential of AR for EnterpriseMark Sage (AREA): Fulfilling the Potential of AR for Enterprise
Mark Sage (AREA): Fulfilling the Potential of AR for Enterprise
AugmentedWorldExpo
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Matthew Skelton
 
Testing Cloud Services
Testing Cloud ServicesTesting Cloud Services
Testing Cloud Services
TechWell
 
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
AlgoSec
 
Bringing the Cloud Back to Earth
Bringing the Cloud Back to EarthBringing the Cloud Back to Earth
Bringing the Cloud Back to Earth
Sri Chalasani
 
Future of Software Testing – IP Led Testing
Future of Software Testing – IP Led TestingFuture of Software Testing – IP Led Testing
Future of Software Testing – IP Led Testing
Cigniti Technologies Ltd
 
ComResource - NW Agent Cybersecurity
ComResource - NW Agent CybersecurityComResource - NW Agent Cybersecurity
ComResource - NW Agent Cybersecurity
Anthony Dials
 
IT Best Practices IT Security Assessments 2010
IT Best Practices IT Security Assessments 2010IT Best Practices IT Security Assessments 2010
IT Best Practices IT Security Assessments 2010
Donald E. Hester
 
10 fa it_security-1
10 fa it_security-110 fa it_security-1
10 fa it_security-1
adiloki
 

Similar to Test Management for Cloud-based Applications (20)

Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
 
Testing Cloud Services - Kees Blokland and Jeroen Mengerink
Testing Cloud Services - Kees Blokland and Jeroen MengerinkTesting Cloud Services - Kees Blokland and Jeroen Mengerink
Testing Cloud Services - Kees Blokland and Jeroen Mengerink
 
Going Cloudy? How to test SaaS? with Kees Blokland
Going Cloudy? How to test SaaS? with Kees Blokland Going Cloudy? How to test SaaS? with Kees Blokland
Going Cloudy? How to test SaaS? with Kees Blokland
 
EuroStar Webinar Testing Cloud Services Kees Blokland
EuroStar Webinar Testing Cloud Services Kees BloklandEuroStar Webinar Testing Cloud Services Kees Blokland
EuroStar Webinar Testing Cloud Services Kees Blokland
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing.
 
Cloud Clinique Enterprise IT Certification Program - Module Matrix
Cloud Clinique   Enterprise IT Certification Program - Module MatrixCloud Clinique   Enterprise IT Certification Program - Module Matrix
Cloud Clinique Enterprise IT Certification Program - Module Matrix
 
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
 
Company Profile
Company ProfileCompany Profile
Company Profile
 
Cyber review-guide
Cyber review-guideCyber review-guide
Cyber review-guide
 
Mark Sage (AREA): Fulfilling the Potential of AR for Enterprise
Mark Sage (AREA): Fulfilling the Potential of AR for EnterpriseMark Sage (AREA): Fulfilling the Potential of AR for Enterprise
Mark Sage (AREA): Fulfilling the Potential of AR for Enterprise
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
 
Testing Cloud Services
Testing Cloud ServicesTesting Cloud Services
Testing Cloud Services
 
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
2019 06-26 effective multi-vendor management -fortinet algo sec webinar final
 
Bringing the Cloud Back to Earth
Bringing the Cloud Back to EarthBringing the Cloud Back to Earth
Bringing the Cloud Back to Earth
 
Future of Software Testing – IP Led Testing
Future of Software Testing – IP Led TestingFuture of Software Testing – IP Led Testing
Future of Software Testing – IP Led Testing
 
ComResource - NW Agent Cybersecurity
ComResource - NW Agent CybersecurityComResource - NW Agent Cybersecurity
ComResource - NW Agent Cybersecurity
 
IT Best Practices IT Security Assessments 2010
IT Best Practices IT Security Assessments 2010IT Best Practices IT Security Assessments 2010
IT Best Practices IT Security Assessments 2010
 
10 fa it_security-1
10 fa it_security-110 fa it_security-1
10 fa it_security-1
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
CatarinaPereira64715
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 

Recently uploaded (20)

ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 

Test Management for Cloud-based Applications

  • 1. TG AM Tutorial 4/30/13 8:30AM Test Management for Cloud-based Applications Presented by: Ruud Teunissen Polteq Test Services BV Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Ruud Teunissen An international test consultant at Polteq Test Services BV, Ruud Teunissen has performed several test functions in a number of IT projects: tester, test specialist, test consultant, and test manager. Ruud participated in the development of the structured testing methodology TMap®—Test Management Approach. Together with Martin Pol and Erik van Veenendaal, Ruud is coauthor of several books on structured testing, including Software Testing: A Guide to the TMap® Approach.
  • 3. Test Management for Cloud Based Applications Ruud Teunissen Polteq Test Services BV The Netherlands 1
  • 4. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring Develop and Test Operate and Manage Email Surf Transfer Store 4 2
  • 5. Develop and Test Email Surf Transfer redundancy, proliferation limitations 80% unused storage claim environmentally unfriendly Operate and Manage Store 5 Develop and Test Email Surf Transfer SOA internet technology virtualization standard software Operate and Manage bandwidth Store 6 3
  • 6. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, Develop and transmitting, learning, controlling, Email analyzing, Test Surf purchasing, testing, alarming, changing, updating, Transfer deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, Operate and Manage accelerating, enhancing, creating, growing,Store checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring 7 4
  • 7. Question Please list your top 5 reasons why you are moving to the cloud 9 Top 5 Reasons 1 2 3 4 5 10 5
  • 8. Essential characteristics On-demand service Self service provisioning, pay-per-use No human interaction US: National Institute of Standards and Technology http://www.nist.gov Essential characteristics On-demand service Broad network access Standard mechanisms over networks “Any” client US: National Institute of Standards and Technology http://www.nist.gov 6
  • 9. Essential characteristics On-demand service Broad network access Resource pooling Multi-tenant Storage, processing, memory, virtual machines, … Location independent US: National Institute of Standards and Technology http://www.nist.gov Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Rapid scale in and out “Any quantity” at any time US: National Institute of Standards and Technology http://www.nist.gov 7
  • 10. Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Measured service Controlled resource use Transparency, pay-per-use US: National Institute of Standards and Technology http://www.nist.gov Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Measured service Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service US: National Institute of Standards and Technology http://www.nist.gov 8
  • 11. Question What is being moved into the cloud? 17 Pack List 1 2 3 4 5 18 9
  • 12. What is “done” in the cloud? <500, SME >500 Consumer Public Private Hybride Community Public *aaS IaaS, PaaS, DaaS, SaaS SaaS Taas *aaS Mail Storage Infrastructure CRM Finance Business processes 19 Data Centre Data Management Business processes Surf and mail Apps Social media Dropbox Google services Spotify Picasa Games …………… Question – Group Discussion Please list your top 5 cloud related risks when you are moving to the cloud 20 10
  • 13. Top 5 Risks 1 2 3 4 5 21 Standards Cyber crime Continuity Privacy Legislation Multi platform Impact organisation 143 11
  • 14. Performance Security Availability & Continuity Functionality Risks Manageability 23 Legislation & Regulations Suppliers & Outsourcing Performance Security YOUR Operational Profile Availability & Continuity Functionality Other customers Risks Manageability 24 Legislation & Regulations Suppliers & Outsourcing YOUR Operational Profile PLUS 12
  • 15. Performance Security The idea: “it’s safe” Availability & Continuity Functionality Everything over the web Risks Manageability 25 Legislation & Regulations Home ground for hackers Suppliers & Outsourcing Performance Security No free choice of device. Availability & Continuity Functionality Bring Your Own Device Risks Manageability 26 Legislation & Regulations Endless possibilities. Suppliers & Outsourcing 13
  • 16. Performance Taken care of. Security Availability & Continuity Functionality Backup and recovery Risks Manageability 27 Legislation & Regulations Who will support me? Suppliers & Outsourcing Performance Security Planned and controlled Availability & Continuity Functionality Updates, patches, fixes, Risks Manageability 28 Legislation & Regulations Do I have a choice? Suppliers & Outsourcing 14
  • 17. Performance In house. Security Availability & Continuity Functionality Where is my data? And is that OK? Risks Manageability 29 Legislation & Regulations Somewhere Suppliers & Outsourcing Performance Security Availability & Continuity Functionality Risks Manageability 30 Legislation & Regulations Suppliers & Outsourcing 15
  • 18. Question – Group Session Let’s look at the clustered risks What test measures would you consider applying? 31 Test Measures 1 2 3 4 5 32 16
  • 19. Testing? Interview Check Trial Proof of concept Intake 33 Performance Testing Security Testing Manageability Testing Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Interview Proof ofProef concept Testen Intake Functional Testing Migration Testing Testing caused by Legislation & Regulations 34 Testing in Production 17
  • 20. Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 35 Legislation & Regulations Suppliers & Outsourcing Testing in Production Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Testing caused by Legislation & Regulations Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 36 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 18
  • 21. Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 37 Legislation & Regulations Suppliers & Outsourcing Testing in Production Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Architecture Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Testing caused by Legislation & Regulations Availability & Continuity Testing Risks From “individual” risks Functional Testing to Manageability “individual” test measures Migration Testing 38 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 19
  • 22. Performance Testing Selection Security Testing Manageability Testing Implementation Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Production Migration Testing Testing caused by Legislation & Regulations Testing in Production 39 Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 40 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 20
  • 23. Performance Testing Security Testing Manageability Testing Selection Criteria Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations 41 Testing in Production Question – Group Session What criteria will you put on your list? 42 21
  • 24. Knock Out List 1 2 3 4 5 43 “Inspiration List” CRITERION PRIO Functional Do the service and the specific business processes align? Does the service fit well in the E2E business process? Is the service sufficiently adaptable to specific requirements? Are many adjustments needed? Is customization possible Is (a lot of) customization needed? Are the required platforms supported? Are “het nieuwe werken” and BYOD supported sufficiently? Is it possible to connect / integrate the service with the other systems? Are sufficient manuals and/or courses available? Implementation Is the impact on current activities acceptable? Is a feasible route for migration towards the service available? 44 22
  • 25. “Inspiration List” CRITERION PRIO Support Are changes in the service announced beforehand? Are sufficient test facilities available around the service (test environment, test tooling, testware, access to infrastructure, …)? Are there sufficient support facilities? Is it clear how incidents can be reported? Are incidents resolved fast enough? Performance Are response times low enough? Is the number of possible simultaneous users high enough? Is bandwidth sufficient? Is sufficient potential for growth available? Is the actual use charged correctly? 45 “Inspiration List” CRITERION PRIO Security Are adequate authorization and authentication possibilities in place? Is the physical security of the service locations sufficient? Is the support access security of the service sufficient? Is mutual access security between customers sufficient? Are data changes traceable? Is data storage for the service reliable? Is deleting data in the service reliable? Is security of the connection to the service sufficient? Are security options for the customer sufficient? Does the supplier have security certificates? (for example SAS 70 type II)? Availability Is the level of availability for the service sufficient? Are back-up / fail-over / disaster-recovery provisions sufficient? 46 23
  • 26. “Inspiration List” CRITERION PRIO Law and regulations Does the data location comply to all legal requirements? Does the data processing comply to all legal requirements? Do the terms contain parts that are conflicting to the duties of the customer? Supplier Is clear what happens when the contract ends, or in case of bankruptcy or conflict? Is a good helpdesk available? Does the supplier have experience in: - Offering this particular service? - Offering services in general? - Developing services? - The customer’s field? - Developing, testing and supporting services (know how)? Do methods used by supplier align with those of the customer (if relevant)? 47 “Inspiration List” CRITERION Supplier Is quality assurance arranged? Is the supplier ahead in its field? Is the size of the supplier in accordance with the expectations of the customer? Does the supplier have a good reputation (are there references)? Is providing services the core business of the supplier? Does the supplier have opportunities for future expansion? Does the supplier speak the same language? Is transparency and flexibility of the supplier sufficient? PRIO 48 24
  • 27. Performance Testing Security Testing Manageability Testing Proof of Concept Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production 49 Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 50 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 25
  • 28. Performance Testing Security Testing Known measures tuned and tweaked Manageability Testing Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing New measures developed Migration Testing Testing caused by Legislation & Regulations Testing in Production 51 YOUR Operational Profile Performance Testing Security Testing Manageability Testing Load Testing Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing YOUR Operational Profile PLUS ACTUAL MOMENT 52 Testing caused by Legislation & Regulations Testing in Production 26
  • 29. Performance Testing Security Testing Manageability Testing Online – Offline Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Use case testing. Global testing. 53 Testing caused by Legislation & Regulations Testing in Production Multiplatform testing. Performance Testing Security Testing Manageability Testing Any device – any platform Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Multiplatform testing. 54 Testing caused by Legislation & Regulations Testing in Production 27
  • 30. Internet Explorer 6 Windows XP Internet Explorer 7 Windows Vista Internet Explorer 8 Windows 7 Firefox 3.5 Windows 2003 server Firefox 3.6 Browsers Windows 8 Firefox 4 Safari 4 Windows CE Safari 5 Linux Operating Systems Chrome11 Unix Opera11 Multiplatform Mac OS Lion PC Mac OS Snowleopard SUN Computer iOS Macintosh Android iPhone .. Windows Mobile Samsung Devices NOKIA Mobile Xxx ASUS.. Blackberry Tablet MOTOROLA Xxx 55 Multiplatform testing. Performance Testing Security Testing Manageability Testing Any device – any platform Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Multiplatform testing. 56 Testing caused by Legislation & Regulations Testing in Production 28
  • 31. Incidental testing. Performance Testing Security Testing Legislation + Regulations = Test basis Manageability Testing Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Compliancy testing. Testing in Production 57 Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Functional Testing Manageability Risks Migration Testing 58 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 29
  • 32. Performance Testing Continuous End-to-End Test Security Testing Manageability Testing Te s t M e a s u r e s Te s t M e a s u r e s Testing during Selection Availability & Continuity Testing Functionals and non-functionals Functional Testing Migration Testing Testing caused by Legislation & Regulations 59 Testing in Production Question – Group Session What would you like to (continue) test(ing) in production? And why? 60 30
  • 33. Testing in production 1 2 3 4 5 61 Testing in production? • Continuity in case of – – – – – – changes changes growth changes changes changes in the service at the supplier in the business process in connected resources in the internet • Measuring guarantees – Avalaibility – Scalability - Performance - Security • Evaluate original selection criteria 62 31
  • 34. Production - Continuous End-to-End test • Mechanism for Detection – Important in an ever changing world • Functionals and non-functionals 63 Standards Cyber crime Check Continuity Interview Privacy Legislation Proof of concept Trial Multi platform Intake Impact organisation 32
  • 35. Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability Test starts earlier & Continuity Testing Test scope is widened Test will never Functional Testing stop Manageability Functionality Risks Migration Testing 65 Legislation & Regulations Suppliers & Outsourcing Testing in Production Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Testing caused by Legislation & Regulations Availability & Continuity Testing Questions? Functional Testing Manageability Risks Migration Testing 66 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production 33
  • 36. Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Functionality Te s t M e a s u r e s Te s t M e a s u r e s Performance Availability & Continuity Testing Thank you! Functional Testing Manageability Risks Migration Testing 67 Legislation & Regulations Suppliers & Outsourcing Testing caused by Legislation & Regulations Testing in Production About the speaker Ruud Teunissen Polteq Test Services, The Netherlands ruud.teunissen@polteq.com - http://www.polteq.com In the testing world since 1989, Ruud Teunissen has held numerous test functions in different organizations and projects: tester, test specialist, test consultant, test manager, etcetera. Ruud is co-author of several books on software testing and is a frequent speaker at (inter)national conferences and workshops. He was a member of the program committee for Quality Week Europe and EuroSTAR. Ruud is currently Senior Test Consultant at Polteq Test Services BV and responsible for the quality of Polteq services and assignments. 68 34