SlideShare a Scribd company logo
KW3
Keynote
5/1/2013 4:30:00 PM

Lightning Strikes the Keynotes
Presented by:
Lee Copeland
Software Quality Engineering

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Lee Copeland
With more than thirty years of experience as an information systems professional at commercial and
nonprofit organizations, Lee Copeland has held technical and managerial positions in applications
development, software testing, and software process improvement. Lee has developed and taught
numerous training courses on software development and testing issues and is a well-known speaker with
Software Quality Engineering. Lee presents at software conferences in the United States and abroad. He
is the author of the popular reference book, A Practitioner’s Guide to Software Test Design.
5/13/2013

Lightning Strikes
The Keynotes

Moderated by

Lee Copeland
lee@sqe.com

Featuring

James Bach

Jennifer Bonine

Dawn Haynes

Jon Bach

Hans Buwalda

Michael Bolton

Bob Galen

Geoff Horne

John Fodeh

Griffin Jones

1
5/13/2013

James Bach

2
5/13/2013

Jon Bach

3
5/13/2013

Michael Bolton

Attention,
Deficit,
Disorder.
Michael Bolton
http://www.developsense.com

4
5/13/2013

aircanada.com

aircanada.com

5
5/13/2013

Error Message
Via Rail, between Montreal and Toronto, 2007

But I can’t contact my… oh, never mind.

Error Message
Via Rail, between Montreal and Toronto, 2007

6
5/13/2013

Hyatt Regency, 2008

If you can’t do math, it’s a nickel extra.

Hyatt Regency, 2008

7
5/13/2013

Why you shouldn’t let an unsupervised
algorithm choose your sponsored links (1).

Vimeo’s Web Page
Spring 2010

Why you shouldn’t let an unsupervised
algorithm choose your sponsored links (2).

Vimeo’s Web Page
Spring 2010

8
5/13/2013

Why you shouldn’t let an unsupervised
algorithm choose your sponsored links (3).

Vimeo’s Web Page
Spring 2010

Google Chrome

9
5/13/2013

Google Calendar Update

OK, fine.

Don’t Know Who This Was

10
5/13/2013

Adobe Acrobat

Adobe Acrobat

11
5/13/2013

Microsoft Outlook

Intuit Quicken

12
5/13/2013

Intuit Quicken

Intuit Quicken

13
5/13/2013

Here’s another err.

Intuit Quicken

ibm.com

14
5/13/2013

Windows

I think I’ll shoot my own trouble for now.

Windows

15
5/13/2013

Windows

I don’t know!

Windows

16
5/13/2013

iTunes

Testing is more than checking.

17
5/13/2013

Welcome to the new world.

“The World of Heineken”
Heineken Experience, Amsterdam, 2006

Jennifer Bonine

18
5/13/2013

Hans Buwalda

19
5/13/2013

Misconceptions of
Test Automation
(and keyword testing)

Hans Buwalda

" automation is easy, no need to think
about it much "

Comments:
I'm still waiting to see my first "easy" automation project
Development is hard, testing is harder, automated testing is the
hardest
If you can't do automation well, be ready to lose time and money
If you can do automated testing well... you're in an enviable position

20
5/13/2013

" test automation means automating
manual tests "

Comments:

+

=

A car is not the same as a carriage with an engine
Good automated testing is not the same as good automation of good
manual testing
Automating manual test designs tends to be cumbersome, uninspiring,
maintenance sensitive, and hard to scale
How you organize and design your tests is the main driver for automation
success

" keywords is a method "

Comments:
Keywords are not much more than a format to write tests in, in itself
not much different from (good) coding of test cases
Some of the worst tests I have seen were keyword tests
I do believe however that keywords are just about the only way to go
for big and complex projects (in addition to exploratory testing). They
just need a method
In my approach "test modules" play a central role for organizing test, to
achieve effective test development and successful automation

21
5/13/2013

Example of a method with keywords:
"Action Based Testing"
Test Module Plan

Test Module 1

Test Module 2

Objectives

Objectives

Tests

Test Module N

Tests

...

Objectives

Tests

Actions

AUTOMATION

interaction test
window

log in
log in

enter
enter

control

business test
user

value

user name jdoe
password StarEast

log in

password

jdoe

StarEast

first

control

property

expected

log in

ok button

enabled

true

last

brand

John
John

Renter
Renter

Ford
Escape
Chevrolet Volt

last

window

check prop

rent car
rent car

model

total

check bill Renter 140.42

" to do automated testing you need to
be a good programmer "

Comments:
The focus should be on testing and test design, not on programming tests
A good tester is not automatically a good programmer, or vice versa
I don't believe we should replace all testers with programmers "in test"

A good programmer can contribute greatly to an airplane control system,
but is not automatically a good airline pilot
Even automation itself is a profession, quite different from regular
programming

22
5/13/2013

" if there are automation problems,
tests should be debugged "

log in
rent car
rent car

Comments:

check bill

user

jdoe
firs t

John
John
last

Renter

pas swo
rd

StarEast
last

Renter
Renter
total

brand

model
Ford
Escape
Chevrole
t Volt

140.42

"Thou should never debug tests"
If observed results are not the expected results, it is not an
automation problem, either the tester or the developer were off
If the application under tests UI isn't accepting your input, run lower
level tests first
If actions aren't working, test them and make them better, before
running your tests with them

" you need an ROI analysis to
determine which tests to automate "

Comments:

$
$ $$ $ $ $
$ $ $ $$
$ $ $ $
$ $

One of the most commonly found statements on test automation
I consider In my view, in a good automated testing effort (my definition
of 'good'), automation is a secondary practical matter
may have to address technology issues to interface with a system under test
good automation is cheap and re-usable, and has a high payoff in time and money

I would rather see an ROI on the tests than on their automation

23
5/13/2013

" automated tests are dumb "

Comments:
They often are very mechanical, and boring, in particular when 1 on 1
based on requirements or specifications, but they don't have to be
Distinguish between an analytical activity ("what to test") and creative
activity ("how to test"), and be mean...
It is the responsibility of the testers to ensure tests are not dumb
automation is not an excuse

Lame tests are not likely to find interesting bugs

" homework "

Are these misconceptions ???
"test automation is the same as programming"
"the most important activity in an automation effort is selecting a tool"
"automation is most suitable for regression testing"
"test automation is a technical challenge"
"if you use keywords your test automation will be successful"
"to have more automation, you just need more people"

24
5/13/2013

Bob Galen

25
5/13/2013

John Fodeh

Ways to Increase
Our Value as Testers
John Fodeh

26
5/13/2013

Value Proposition

Testing

Cost

Productivity

Quality

27
5/13/2013

7 Quality Enhancing Features
Domain
insight
Leadership
skills
Lateral
& system
thinking

Automation

Modeling
Programming
fundamentals

Testing
techniques

28
5/13/2013

29
5/13/2013

Dawn Haynes

30
5/13/2013

D
A

Data
Areas

D

A
R
T

R
Rules

S

T
Trails

S States

Data
Areas

Follow the
Evaluate
popcorn trail
interacting
of data …
state models

Rules
Trails
States

Same data,
different areas
Check rules
in various
states

31
5/13/2013

Geoff Horne

32
5/13/2013

Griffin Jones

33
5/13/2013

WREST
Workshop on Regulated Software Testing

Software subject to review by
an internal or external regulatory body

Purpose and Format
• Share and generate ideas and
techniques
• Provide a forum for people
interested in the topic
• Participation is free and open to
all
• LAWST-style rules of
engagement

34
5/13/2013

Workshop Structure
• Facilitated
• Series of experiential
presentations and group
discussions
• Atmosphere is collaborative,
supportive and constructive
• Focus on the practical and
useful

More Information
• Next WREST: Friday, May 3rd
2013
Hosted by SQE here at
STAREAST
• Contact:
Karen N. Johnson, John
McConda, Griffin Jones
• Website: wrestworkshop.com

35
5/13/2013

Our Thanks To

James Bach

Jennifer Bonine

Dawn Haynes

Jon Bach

Hans Buwalda

Michael Bolton

Bob Galen

Geoff Horne

John Fodeh

Griffin Jones

36

More Related Content

What's hot

Use Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software ForestUse Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software Forest
TechWell
 
Specification by example and agile acceptance testing
Specification by example and agile acceptance testingSpecification by example and agile acceptance testing
Specification by example and agile acceptance testing
gojkoadzic
 
The 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating systemThe 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating system
Aidan Tierney
 
Spec by-example
Spec by-exampleSpec by-example
Spec by-example
David Navarro Alvarez
 
Test automation – the bitter truth
Test automation – the bitter truthTest automation – the bitter truth
Test automation – the bitter truth
Viktor Slavchev
 
"Worst" practices of software testing
"Worst" practices of software testing"Worst" practices of software testing
"Worst" practices of software testing
Viktor Slavchev
 
I dream of ISPWeb
I dream of ISPWebI dream of ISPWeb
I dream of ISPWeb
Gil Zilberfeld
 
Exploratory Testing
Exploratory TestingExploratory Testing
Exploratory Testing
sriks7
 
Bug Advocacy
Bug AdvocacyBug Advocacy
Bug Advocacy
nazeer pasha
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Bug Advocacy
Bug AdvocacyBug Advocacy
Bug Advocacy
Deepu S Nath
 
Prototyping Workshop
Prototyping WorkshopPrototyping Workshop
Prototyping Workshop
Tamara Pinos
 
Agile Testing Dilemmas
Agile Testing DilemmasAgile Testing Dilemmas
Agile Testing Dilemmas
Aman King
 
Blunders in Test Automation
Blunders in Test AutomationBlunders in Test Automation
Developers Border Line: Unit Testing
Developers Border Line: Unit TestingDevelopers Border Line: Unit Testing
Developers Border Line: Unit Testing
Sikandar Ahmed
 
Effective specifications for agile teams
Effective specifications for agile teamsEffective specifications for agile teams
Effective specifications for agile teams
gojkoadzic
 
Accessibility Support Baseline: Balancing User Needs Against Test Effort
Accessibility Support Baseline: Balancing User Needs Against Test EffortAccessibility Support Baseline: Balancing User Needs Against Test Effort
Accessibility Support Baseline: Balancing User Needs Against Test Effort
Aidan Tierney
 
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
TEST Huddle
 
测试向前一步
测试向前一步测试向前一步
测试向前一步drewz lin
 
Become Software Tester or Developer
Become Software Tester or DeveloperBecome Software Tester or Developer
Become Software Tester or Developer
KMS Technology
 

What's hot (20)

Use Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software ForestUse Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software Forest
 
Specification by example and agile acceptance testing
Specification by example and agile acceptance testingSpecification by example and agile acceptance testing
Specification by example and agile acceptance testing
 
The 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating systemThe 7 minute accessibility assessment and app rating system
The 7 minute accessibility assessment and app rating system
 
Spec by-example
Spec by-exampleSpec by-example
Spec by-example
 
Test automation – the bitter truth
Test automation – the bitter truthTest automation – the bitter truth
Test automation – the bitter truth
 
"Worst" practices of software testing
"Worst" practices of software testing"Worst" practices of software testing
"Worst" practices of software testing
 
I dream of ISPWeb
I dream of ISPWebI dream of ISPWeb
I dream of ISPWeb
 
Exploratory Testing
Exploratory TestingExploratory Testing
Exploratory Testing
 
Bug Advocacy
Bug AdvocacyBug Advocacy
Bug Advocacy
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Bug Advocacy
Bug AdvocacyBug Advocacy
Bug Advocacy
 
Prototyping Workshop
Prototyping WorkshopPrototyping Workshop
Prototyping Workshop
 
Agile Testing Dilemmas
Agile Testing DilemmasAgile Testing Dilemmas
Agile Testing Dilemmas
 
Blunders in Test Automation
Blunders in Test AutomationBlunders in Test Automation
Blunders in Test Automation
 
Developers Border Line: Unit Testing
Developers Border Line: Unit TestingDevelopers Border Line: Unit Testing
Developers Border Line: Unit Testing
 
Effective specifications for agile teams
Effective specifications for agile teamsEffective specifications for agile teams
Effective specifications for agile teams
 
Accessibility Support Baseline: Balancing User Needs Against Test Effort
Accessibility Support Baseline: Balancing User Needs Against Test EffortAccessibility Support Baseline: Balancing User Needs Against Test Effort
Accessibility Support Baseline: Balancing User Needs Against Test Effort
 
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
 
测试向前一步
测试向前一步测试向前一步
测试向前一步
 
Become Software Tester or Developer
Become Software Tester or DeveloperBecome Software Tester or Developer
Become Software Tester or Developer
 

Viewers also liked

It Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
It Seemed a Good Idea at the Time: Intelligent Mistakes in Test AutomationIt Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
It Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
TechWell
 
Better Security Testing: Using the Cloud and Continuous Delivery
Better Security Testing: Using the Cloud and Continuous DeliveryBetter Security Testing: Using the Cloud and Continuous Delivery
Better Security Testing: Using the Cloud and Continuous Delivery
TechWell
 
Specification-by-Example: A Cucumber Implementation
Specification-by-Example: A Cucumber ImplementationSpecification-by-Example: A Cucumber Implementation
Specification-by-Example: A Cucumber Implementation
TechWell
 
Tune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product MaturityTune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product Maturity
TechWell
 
New Testing Standards Are on the Horizon: What Will Be Their Impact?
New Testing Standards Are on the Horizon: What Will Be Their Impact?New Testing Standards Are on the Horizon: What Will Be Their Impact?
New Testing Standards Are on the Horizon: What Will Be Their Impact?
TechWell
 
How Spotify Tests World Class Apps
How Spotify Tests World Class AppsHow Spotify Tests World Class Apps
How Spotify Tests World Class Apps
TechWell
 
Maybe We Don’t Have to Test It
Maybe We Don’t Have to Test ItMaybe We Don’t Have to Test It
Maybe We Don’t Have to Test It
TechWell
 
Build Your Own Performance Test Lab in the Cloud
Build Your Own Performance Test Lab in the CloudBuild Your Own Performance Test Lab in the Cloud
Build Your Own Performance Test Lab in the Cloud
TechWell
 
Innovations in Test Automation: It’s Not All about Regression
Innovations in Test Automation: It’s Not All about RegressionInnovations in Test Automation: It’s Not All about Regression
Innovations in Test Automation: It’s Not All about Regression
TechWell
 
Planning Your Agile Testing: A Practical Guide
Planning Your Agile Testing: A Practical GuidePlanning Your Agile Testing: A Practical Guide
Planning Your Agile Testing: A Practical Guide
TechWell
 
Keynote: Lean Software Delivery: Synchronizing Cadence with Context
Keynote: Lean Software Delivery: Synchronizing Cadence with ContextKeynote: Lean Software Delivery: Synchronizing Cadence with Context
Keynote: Lean Software Delivery: Synchronizing Cadence with Context
TechWell
 
Introducing Mobile Testing to Your Organization
Introducing Mobile Testing to Your OrganizationIntroducing Mobile Testing to Your Organization
Introducing Mobile Testing to Your Organization
TechWell
 
Pay Now or Pay More Every Day: Reduce Technical Debt Now!
Pay Now or Pay More Every Day: Reduce Technical Debt Now!Pay Now or Pay More Every Day: Reduce Technical Debt Now!
Pay Now or Pay More Every Day: Reduce Technical Debt Now!
TechWell
 
Testing—After You’ve Finished Testing
Testing—After You’ve Finished TestingTesting—After You’ve Finished Testing
Testing—After You’ve Finished Testing
TechWell
 
Exploratory Testing Is Now in Session
Exploratory Testing Is Now in SessionExploratory Testing Is Now in Session
Exploratory Testing Is Now in Session
TechWell
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
TechWell
 

Viewers also liked (16)

It Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
It Seemed a Good Idea at the Time: Intelligent Mistakes in Test AutomationIt Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
It Seemed a Good Idea at the Time: Intelligent Mistakes in Test Automation
 
Better Security Testing: Using the Cloud and Continuous Delivery
Better Security Testing: Using the Cloud and Continuous DeliveryBetter Security Testing: Using the Cloud and Continuous Delivery
Better Security Testing: Using the Cloud and Continuous Delivery
 
Specification-by-Example: A Cucumber Implementation
Specification-by-Example: A Cucumber ImplementationSpecification-by-Example: A Cucumber Implementation
Specification-by-Example: A Cucumber Implementation
 
Tune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product MaturityTune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product Maturity
 
New Testing Standards Are on the Horizon: What Will Be Their Impact?
New Testing Standards Are on the Horizon: What Will Be Their Impact?New Testing Standards Are on the Horizon: What Will Be Their Impact?
New Testing Standards Are on the Horizon: What Will Be Their Impact?
 
How Spotify Tests World Class Apps
How Spotify Tests World Class AppsHow Spotify Tests World Class Apps
How Spotify Tests World Class Apps
 
Maybe We Don’t Have to Test It
Maybe We Don’t Have to Test ItMaybe We Don’t Have to Test It
Maybe We Don’t Have to Test It
 
Build Your Own Performance Test Lab in the Cloud
Build Your Own Performance Test Lab in the CloudBuild Your Own Performance Test Lab in the Cloud
Build Your Own Performance Test Lab in the Cloud
 
Innovations in Test Automation: It’s Not All about Regression
Innovations in Test Automation: It’s Not All about RegressionInnovations in Test Automation: It’s Not All about Regression
Innovations in Test Automation: It’s Not All about Regression
 
Planning Your Agile Testing: A Practical Guide
Planning Your Agile Testing: A Practical GuidePlanning Your Agile Testing: A Practical Guide
Planning Your Agile Testing: A Practical Guide
 
Keynote: Lean Software Delivery: Synchronizing Cadence with Context
Keynote: Lean Software Delivery: Synchronizing Cadence with ContextKeynote: Lean Software Delivery: Synchronizing Cadence with Context
Keynote: Lean Software Delivery: Synchronizing Cadence with Context
 
Introducing Mobile Testing to Your Organization
Introducing Mobile Testing to Your OrganizationIntroducing Mobile Testing to Your Organization
Introducing Mobile Testing to Your Organization
 
Pay Now or Pay More Every Day: Reduce Technical Debt Now!
Pay Now or Pay More Every Day: Reduce Technical Debt Now!Pay Now or Pay More Every Day: Reduce Technical Debt Now!
Pay Now or Pay More Every Day: Reduce Technical Debt Now!
 
Testing—After You’ve Finished Testing
Testing—After You’ve Finished TestingTesting—After You’ve Finished Testing
Testing—After You’ve Finished Testing
 
Exploratory Testing Is Now in Session
Exploratory Testing Is Now in SessionExploratory Testing Is Now in Session
Exploratory Testing Is Now in Session
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 

Similar to Keynote: Lightning Strikes the Keynotes

Software testing 2012 - A Year in Review
Software testing 2012 - A Year in ReviewSoftware testing 2012 - A Year in Review
Software testing 2012 - A Year in ReviewJohan Hoberg
 
Automation testing: how tools are important?
Automation testing: how tools are important?Automation testing: how tools are important?
Automation testing: how tools are important?
MD ISLAM
 
Best practices for test automation
Best practices for test automationBest practices for test automation
Best practices for test automation
David Tzemach
 
Alan Page: On Testing
Alan Page: On TestingAlan Page: On Testing
Alan Page: On Testing
TechWell
 
Test Automation
Test AutomationTest Automation
Test Automation
Mphasis
 
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIESCHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIESSamruddhi Sheth
 
Manual Tester To Automation Tester
Manual Tester To Automation Tester Manual Tester To Automation Tester
Manual Tester To Automation Tester
Kalyan Katuru
 
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
TEST Huddle
 
Phil Koopman's ISSRE 2016 Keynote
Phil Koopman's ISSRE 2016 KeynotePhil Koopman's ISSRE 2016 Keynote
Phil Koopman's ISSRE 2016 Keynote
edgecaseresearch
 
Sprinkle on Just Enough Process
Sprinkle on Just Enough ProcessSprinkle on Just Enough Process
Sprinkle on Just Enough Process
TechWell
 
software testing
software testingsoftware testing
software testing
choclatyhero007
 
GLA Testing Presentation by Test Partners Ltd v1
GLA Testing Presentation by Test Partners Ltd v1GLA Testing Presentation by Test Partners Ltd v1
GLA Testing Presentation by Test Partners Ltd v1
Unboxed
 
#Resource1
#Resource1#Resource1
#Resource1
Dragan Mihai
 
Successful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s ViewSuccessful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s View
TechWell
 
Psychology and Engineering of Testing
Psychology and Engineering of TestingPsychology and Engineering of Testing
Psychology and Engineering of Testing
Ilari Henrik Aegerter
 
Test automation Anecdotes
Test automation AnecdotesTest automation Anecdotes
Test automation Anecdotes
Cristiano Caetano
 
5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile Development5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile Development
Arin Sime
 
Chicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall worldChicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall world
Angela Dugan
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
TEST Huddle
 
utplsql.pdf
utplsql.pdfutplsql.pdf
utplsql.pdf
vijayv991893
 

Similar to Keynote: Lightning Strikes the Keynotes (20)

Software testing 2012 - A Year in Review
Software testing 2012 - A Year in ReviewSoftware testing 2012 - A Year in Review
Software testing 2012 - A Year in Review
 
Automation testing: how tools are important?
Automation testing: how tools are important?Automation testing: how tools are important?
Automation testing: how tools are important?
 
Best practices for test automation
Best practices for test automationBest practices for test automation
Best practices for test automation
 
Alan Page: On Testing
Alan Page: On TestingAlan Page: On Testing
Alan Page: On Testing
 
Test Automation
Test AutomationTest Automation
Test Automation
 
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIESCHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
 
Manual Tester To Automation Tester
Manual Tester To Automation Tester Manual Tester To Automation Tester
Manual Tester To Automation Tester
 
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
 
Phil Koopman's ISSRE 2016 Keynote
Phil Koopman's ISSRE 2016 KeynotePhil Koopman's ISSRE 2016 Keynote
Phil Koopman's ISSRE 2016 Keynote
 
Sprinkle on Just Enough Process
Sprinkle on Just Enough ProcessSprinkle on Just Enough Process
Sprinkle on Just Enough Process
 
software testing
software testingsoftware testing
software testing
 
GLA Testing Presentation by Test Partners Ltd v1
GLA Testing Presentation by Test Partners Ltd v1GLA Testing Presentation by Test Partners Ltd v1
GLA Testing Presentation by Test Partners Ltd v1
 
#Resource1
#Resource1#Resource1
#Resource1
 
Successful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s ViewSuccessful Test Automation: A Manager’s View
Successful Test Automation: A Manager’s View
 
Psychology and Engineering of Testing
Psychology and Engineering of TestingPsychology and Engineering of Testing
Psychology and Engineering of Testing
 
Test automation Anecdotes
Test automation AnecdotesTest automation Anecdotes
Test automation Anecdotes
 
5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile Development5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile Development
 
Chicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall worldChicago Code Camp 2014 - Agile Testing in a waterfall world
Chicago Code Camp 2014 - Agile Testing in a waterfall world
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
 
utplsql.pdf
utplsql.pdfutplsql.pdf
utplsql.pdf
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Recently uploaded

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 

Recently uploaded (20)

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 

Keynote: Lightning Strikes the Keynotes

  • 1. KW3 Keynote 5/1/2013 4:30:00 PM Lightning Strikes the Keynotes Presented by: Lee Copeland Software Quality Engineering Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Lee Copeland With more than thirty years of experience as an information systems professional at commercial and nonprofit organizations, Lee Copeland has held technical and managerial positions in applications development, software testing, and software process improvement. Lee has developed and taught numerous training courses on software development and testing issues and is a well-known speaker with Software Quality Engineering. Lee presents at software conferences in the United States and abroad. He is the author of the popular reference book, A Practitioner’s Guide to Software Test Design.
  • 3. 5/13/2013 Lightning Strikes The Keynotes Moderated by Lee Copeland lee@sqe.com Featuring James Bach Jennifer Bonine Dawn Haynes Jon Bach Hans Buwalda Michael Bolton Bob Galen Geoff Horne John Fodeh Griffin Jones 1
  • 8. 5/13/2013 Error Message Via Rail, between Montreal and Toronto, 2007 But I can’t contact my… oh, never mind. Error Message Via Rail, between Montreal and Toronto, 2007 6
  • 9. 5/13/2013 Hyatt Regency, 2008 If you can’t do math, it’s a nickel extra. Hyatt Regency, 2008 7
  • 10. 5/13/2013 Why you shouldn’t let an unsupervised algorithm choose your sponsored links (1). Vimeo’s Web Page Spring 2010 Why you shouldn’t let an unsupervised algorithm choose your sponsored links (2). Vimeo’s Web Page Spring 2010 8
  • 11. 5/13/2013 Why you shouldn’t let an unsupervised algorithm choose your sponsored links (3). Vimeo’s Web Page Spring 2010 Google Chrome 9
  • 12. 5/13/2013 Google Calendar Update OK, fine. Don’t Know Who This Was 10
  • 17. 5/13/2013 Windows I think I’ll shoot my own trouble for now. Windows 15
  • 19. 5/13/2013 iTunes Testing is more than checking. 17
  • 20. 5/13/2013 Welcome to the new world. “The World of Heineken” Heineken Experience, Amsterdam, 2006 Jennifer Bonine 18
  • 22. 5/13/2013 Misconceptions of Test Automation (and keyword testing) Hans Buwalda " automation is easy, no need to think about it much " Comments: I'm still waiting to see my first "easy" automation project Development is hard, testing is harder, automated testing is the hardest If you can't do automation well, be ready to lose time and money If you can do automated testing well... you're in an enviable position 20
  • 23. 5/13/2013 " test automation means automating manual tests " Comments: + = A car is not the same as a carriage with an engine Good automated testing is not the same as good automation of good manual testing Automating manual test designs tends to be cumbersome, uninspiring, maintenance sensitive, and hard to scale How you organize and design your tests is the main driver for automation success " keywords is a method " Comments: Keywords are not much more than a format to write tests in, in itself not much different from (good) coding of test cases Some of the worst tests I have seen were keyword tests I do believe however that keywords are just about the only way to go for big and complex projects (in addition to exploratory testing). They just need a method In my approach "test modules" play a central role for organizing test, to achieve effective test development and successful automation 21
  • 24. 5/13/2013 Example of a method with keywords: "Action Based Testing" Test Module Plan Test Module 1 Test Module 2 Objectives Objectives Tests Test Module N Tests ... Objectives Tests Actions AUTOMATION interaction test window log in log in enter enter control business test user value user name jdoe password StarEast log in password jdoe StarEast first control property expected log in ok button enabled true last brand John John Renter Renter Ford Escape Chevrolet Volt last window check prop rent car rent car model total check bill Renter 140.42 " to do automated testing you need to be a good programmer " Comments: The focus should be on testing and test design, not on programming tests A good tester is not automatically a good programmer, or vice versa I don't believe we should replace all testers with programmers "in test" A good programmer can contribute greatly to an airplane control system, but is not automatically a good airline pilot Even automation itself is a profession, quite different from regular programming 22
  • 25. 5/13/2013 " if there are automation problems, tests should be debugged " log in rent car rent car Comments: check bill user jdoe firs t John John last Renter pas swo rd StarEast last Renter Renter total brand model Ford Escape Chevrole t Volt 140.42 "Thou should never debug tests" If observed results are not the expected results, it is not an automation problem, either the tester or the developer were off If the application under tests UI isn't accepting your input, run lower level tests first If actions aren't working, test them and make them better, before running your tests with them " you need an ROI analysis to determine which tests to automate " Comments: $ $ $$ $ $ $ $ $ $ $$ $ $ $ $ $ $ One of the most commonly found statements on test automation I consider In my view, in a good automated testing effort (my definition of 'good'), automation is a secondary practical matter may have to address technology issues to interface with a system under test good automation is cheap and re-usable, and has a high payoff in time and money I would rather see an ROI on the tests than on their automation 23
  • 26. 5/13/2013 " automated tests are dumb " Comments: They often are very mechanical, and boring, in particular when 1 on 1 based on requirements or specifications, but they don't have to be Distinguish between an analytical activity ("what to test") and creative activity ("how to test"), and be mean... It is the responsibility of the testers to ensure tests are not dumb automation is not an excuse Lame tests are not likely to find interesting bugs " homework " Are these misconceptions ??? "test automation is the same as programming" "the most important activity in an automation effort is selecting a tool" "automation is most suitable for regression testing" "test automation is a technical challenge" "if you use keywords your test automation will be successful" "to have more automation, you just need more people" 24
  • 28. 5/13/2013 John Fodeh Ways to Increase Our Value as Testers John Fodeh 26
  • 30. 5/13/2013 7 Quality Enhancing Features Domain insight Leadership skills Lateral & system thinking Automation Modeling Programming fundamentals Testing techniques 28
  • 33. 5/13/2013 D A Data Areas D A R T R Rules S T Trails S States Data Areas Follow the Evaluate popcorn trail interacting of data … state models Rules Trails States Same data, different areas Check rules in various states 31
  • 36. 5/13/2013 WREST Workshop on Regulated Software Testing Software subject to review by an internal or external regulatory body Purpose and Format • Share and generate ideas and techniques • Provide a forum for people interested in the topic • Participation is free and open to all • LAWST-style rules of engagement 34
  • 37. 5/13/2013 Workshop Structure • Facilitated • Series of experiential presentations and group discussions • Atmosphere is collaborative, supportive and constructive • Focus on the practical and useful More Information • Next WREST: Friday, May 3rd 2013 Hosted by SQE here at STAREAST • Contact: Karen N. Johnson, John McConda, Griffin Jones • Website: wrestworkshop.com 35
  • 38. 5/13/2013 Our Thanks To James Bach Jennifer Bonine Dawn Haynes Jon Bach Hans Buwalda Michael Bolton Bob Galen Geoff Horne John Fodeh Griffin Jones 36