Slides from tutorial. Note that the most important part of the tutorial is the exercises, and I can't capture that in the slide deck. Please do not use these for public paid courses, I'm tired of our stuff being ripped off for agile testing classes.
Advanced Topics in Agile Tsting: Focus on Automationlisacrispin
Slide deck for workshop facilitated by Lisa Crispin and Janet Gregory at Quality in Agile Vancouver 2015. Outcomes from the workshop including all the mind maps will appear eventually on lisacrispin.com.
Maximize the value of your work by practicing DevOps with Scrum Framework. Building and deploy continuously within sprint with help of DevOps culture, tools and practices.
Workshop given at Agile Testing Days 2017 together with Lisa Crispin: "Testing in a Continuous World - How to Continuously Learn for Successful Continuous Delivery"
Abstract:
Nowadays users are quite used to getting product updates every other day. Many teams want to release updates to production more frequently, but they’re struggling to complete testing activities and fear that they might deliver big bugs instead of valuable features. Continuous delivery of reliable software is a huge challenge.
Many teams already develop their products in small chunks, but how does testing and quality fit into this fast-paced scenario? How can we not only continuously deliver, but continuously provide value to our users?
Elisabeth and Lisa have worked in teams who struggled to have testing fully integrated, being able to only release once every few weeks. They’ve also experienced highly collaborative teams who could easily deliver multiple times a day to quickly validate if they added value. What's your situation, can you keep up with testing and release frequently?
In this hands-on workshop, participants will have a chance to practice techniques that can help teams feel confident releasing more frequently. We will facilitate activities in which participants will come up with new experiments to help shorten feedback cycles, make sure all essential types of testing are done continually, and fit testing into the continuous world. Let's share experiences and develop custom solutions for your specific scenarios together!
Advanced Topics in Agile Tsting: Focus on Automationlisacrispin
Slide deck for workshop facilitated by Lisa Crispin and Janet Gregory at Quality in Agile Vancouver 2015. Outcomes from the workshop including all the mind maps will appear eventually on lisacrispin.com.
Maximize the value of your work by practicing DevOps with Scrum Framework. Building and deploy continuously within sprint with help of DevOps culture, tools and practices.
Workshop given at Agile Testing Days 2017 together with Lisa Crispin: "Testing in a Continuous World - How to Continuously Learn for Successful Continuous Delivery"
Abstract:
Nowadays users are quite used to getting product updates every other day. Many teams want to release updates to production more frequently, but they’re struggling to complete testing activities and fear that they might deliver big bugs instead of valuable features. Continuous delivery of reliable software is a huge challenge.
Many teams already develop their products in small chunks, but how does testing and quality fit into this fast-paced scenario? How can we not only continuously deliver, but continuously provide value to our users?
Elisabeth and Lisa have worked in teams who struggled to have testing fully integrated, being able to only release once every few weeks. They’ve also experienced highly collaborative teams who could easily deliver multiple times a day to quickly validate if they added value. What's your situation, can you keep up with testing and release frequently?
In this hands-on workshop, participants will have a chance to practice techniques that can help teams feel confident releasing more frequently. We will facilitate activities in which participants will come up with new experiments to help shorten feedback cycles, make sure all essential types of testing are done continually, and fit testing into the continuous world. Let's share experiences and develop custom solutions for your specific scenarios together!
Let's explore what is agile testing, how agile testing is different than traditional testing. What practices team has to adopt to have parallel testing and how to create your own test automation framework. Test automation frameworks using cucumber, selenium, junit, nunit, rspec, coded UI etc.
It can be confusing for everyone in an agile team to understand when or what to test, when there isn't a test phase or any formal documented requirements. Whatever your agile methodology, projects require a change in the way QA and development work together. The use of technology and automation are much more difficult and finding a practical approach to testing is critical for successful agile projects.
In the Webinar presentation, George Wilson explored how testing in agile is different and revealed pragmatic advice to ensure that application quality, within an agile environment, isn't compromised. Listen to the archive Webinar discussion on the techniques for quickly getting control of manual testing and progressing to automated testing in agile, which will leave you with fresh thinking to resolve or prevent any testing dysfunctions in your agile teams.
- See more at: http://www.origsoft.com/webinars/agile_testing/
Exploratory testing in an agile development organization (it quality & test ...Johan Åtting
A case about how a company (Sectra) is using Exploratory Testing in their agile development organization where testers and developers are sitting together in cross functional teams using Scrum.
Learn how your emotions play an important part in your success as a team member, how you can understand them better, and how you can use this to make you a better person.
Klaus Olsen - Agile Test Management Using ScrumTEST Huddle
EuroSTAR Software Testing Conference 2008 presentation on Agile Test Management Using Scrum by Klaus Olsen. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
Build the "right" regression suite using Behavior Driven Testing (BDT)Anand Bagmar
Behavior Driven Testing (BDT) is an evolved way of thinking about Testing. It helps in identifying the 'correct' scenarios, in form of user journeys, to build a good and effective (manual & automation) regression suite that validates the Business Goals.
Esta presentación muestra el contenido de la charla online, cuyo objetivo es poner sobre la mesa la diversidad de desafíos que tienen los Testers/Probadores de Software, y dar una breve reseña de los cambios que hay tanto en los procesos como en los aspectos de la tecnología de Testing y que invitan a que nos adaptemos rápidamente.
Información del Evento
Título del Evento: Los nuevos desafíos del Testing
Expositora: María José Pérez Zavala (LinkedIn)
Tipo de Evento: No Arancelado
Plataforma: Hangout en Directo
Fecha del Evento: 12/12/15
Inicio: 10:00 am (GMT -03:00)
Fin: 12:00 am (GMT -03:00)
Comentarios:
Se transmitirá en directo por YouTube.
Minutos antes del Inicio del evento estaremos publicando la url para que puedas acceder, seguir la charla y hasta incluso participar con tus comentarios y/o preguntas.
Agile Methodology is not new. Many organisations / teams have already adopted Agile way of Software Development or are in the enablement journey for the same. What does this mean for Testing? There is no doubt that the Testing approach and mindset also needs to change to be in tune with the Agile Development methodology.
Learn what does it mean to Test on Agile Projects and how Test Automation approach needs to change for the team to be successful! Also learn why is Test Automation important, and how do we implement a good, robust, scalable and maintainable Test Automation framework!
Agile testing principles and practices - Anil KaradeIndicThreads
Traditional test processes are not adaptive to extensive changes in software. Agile process emphasizes on ability to adapt to changing business needs, customer collaboration, integrated teams and frequent delivery of business values. Agile is an umbrella term that describes a variety of methods including XP and Scrum.
The talk will discuss pitfalls of the traditional testing process. Traditional testing process happens very late in the SDLC Where as Agile process focuses on test-first approach. The talk will explain benefits of going agile. Principles and practices of agile process will be discussed and agile methodologies Scrum and Extreme Programming will be discussed in detail. Purpose of Scrum, its effectiveness, timings and managing the scrum will be discussed. Some of the practices for XP like Pair Programming, Test Driven Development will be discussed. The Talk will also cover the QA role in agile world. The talk will cover the implementation issues while shifting from traditional to agile process. Talk will also include an interactive game for illustration of concepts.
Common Objections to TDD (and their refutations)Seb Rose
This is not a deck about how or why to practice TDD. Based upon research conducted, I outline the most common objections to TDD and describe how to refute (or more properly rebut), avoid or mitigate each of them. The coverage acknowledges that there are risks inherent to all techniques and does not promote the idea that TDD is some kind of silver bullet.
Testing is integral to any Agile development process. This slide deck offers an overview of Agile testing-related practices and explains how they work together to mitigate the most common sources of risk on any project.
This episode takes what you have learned about testing and static code analysis to uncover the hidden costs of development that we all know about, but rarely confront. Error-prone tasks, lack of actionable data, waiting for resources, and unaccounted “bug fix crowdsourcing” are just a few of the sources for latency in software projects.
Agile Anti-Patterns. Yes your agile projects can and will fail too.Sander Hoogendoorn
This is the slide deck for a smooth presentation on agile and agile anti-patterns I did recently at several international conferences, including GIDS (Bangalore), ACCU (Oxford), Camp Digital (Manchester), Agile Open Holland (Dieren) and Jazoon (Zurich).
Why software will never be the same... Discuss why agile and lean development methodologies alone are not enough to compete in today's software startup market. Explore real-time prototyping and minimal viable experiments that can accelerate learning down to hours, not sprints.
Analysis of the interaction between practices for introducing XP effectivelyMakoto SAKAI
In this paper, we discuss interactions between XP (eXtreme Programming) practices. We discuss 2 case studies of introducing XP practices selectively from the 13 practices which are defined in XP, and we analyze how to select practices. Our analysis is based on interviews with developers. While it is difficult to introduce all the XP practices at once, our knowledge makes it easier to determine more effective combinations of practices.
Software quality is critical to consistently and continually delivering new features to our users. This talk covers the importance of software quality and how to deliver it via unit testing, Test Driven Development and clean code in general.
This is the deck from a talk I gave at Desert Code Camp 2013.
EuroSTAR Software Testing Conference 2013 presentation on Readable, Executable Requirements: Hands-On by Emily Bache.
See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Do your unit tests feel like a chore to maintain? Are they sometimes useful but come with a high maintenance cost? Do you secretly believe you’d work faster without them there? A great test suite should help speed up your development process, not slow you down. This talk highlights some techniques you can use to improve the front-end unit tests you write.
The slides of the Global Day of Coderetreat Munich 2018 I facilitated and we organized in the context of our Software Craft Meetup Munich on 17.11.2018.
Julian Harty - Alternatives To Testing - EuroSTAR 2010TEST Huddle
EuroSTAR Software Testing Conference 2010 presentation on "Presentation Title" by "Speaker Name". See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Exploring Requirements for Shared Understandinglisacrispin
Janet Gregory and Lisa Crispin explain techniques for teams to build shared understanding across all roles of the features and stories they are building.
Get testing bottlenecks out of your pipelineslisacrispin
When teams move towards continuous delivery and deployment, how do they manage the manual stages in their deployment pipeline? This talk gives some techniques to visualize pipelines, identify bottlenecks, find ways to remove them.
Thinking Outside the Box: Cognitive bias and testinglisacrispin
Cognitive biases can get in the way of effective testing. How can we compensate for them and do more "outside the box" thinking? Presented at Motrix Ministry of Testing Cork. Meetup April 15 2020
The Whole Team Approach to Quality in Continuous Deliverylisacrispin
Lisa shares her teams' experiences with making a team commitment to quality and learning ways to build it in and fit all testing activities into continuous delivery.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentations
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Belgium Testing Days - Making Test Automation Work in Agile Projects
1. Making Test
Automation Work in
Agile Projects
Belgium Testing Days 2012
Lisa Crispin
With Material from Janet Gregory
1
2. Introductions: Experience, Goals
Form groups:
New to automation
One to two years experience w/ automation
More than two years experience
Talk with at least two other people
Tell each other your learning goals for today
Note the most interesting one you hear
2
4. Introduction - You
Main role on team?
Programming, automation experience?
Using agile approach?
What have you automated? (Test,
CI,deployment...)
4
Copyright 2012: Lisa Crispin
5. Takeaways
Foundation for successful test automation
“Whole Team” approach
What/when to automate
Identifying, overcoming barriers
Choosing, implementing tools
First steps
We won’t do any hands-on automation, but will demo
some examples
5
Copyright 2012: Lisa Crispin
6. Exercise: Your Learning Goals
Write one interesting learning goal you heard
from another participant at the start of the
class on a sticky note.
Write your number one learning goal for
today on a sticky note.
Put the sticky notes on your table group
“learning goals” sheet
Group similar ones together
6
7. Let‟s start by defining “agile”
Agile teams:
Deliver business value
frequently
at a sustainable pace
while adapting to the changing
needs of the business
Source: Elisabeth Hendrickson
7
Copyright 2012: Lisa Crispin
8. The key is “sustainable pace”
Technical debt slows us down
8
Copyright 2012: Lisa Crispin
10. High technical debt +
insufficient automation = even
less time
Copyright 2012: Lisa Crispin
11. Barriers to Test Automation
What‟s holding you back?
11
Copyright 2012: Lisa Crispin
12. Exercise: Your barriers
Individually and silently – write one barrier
hindering your team per sticky note
Put these on the “impediments” wall chart
for your table group
Talk to your fellow group members – do you
see any patterns?
12
Copyright 2012: Lisa Crispin
14. The Whole-Team Approach
Automated tests are code
Respecting the tests
Collaborating
Commitment to quality
Return on investment
14
Copyright 2012: Lisa Crispin
15. Automated tests are code
public class CalculatorFixture extends
ColumnFixture {
public String startDate;
public String endDate;
public double startBalance;
public double endBalance;
public String irrTarget;
private Calculator calculator = new
Calculator();
private Double irr;
15
Copyright 2012: Lisa Crispin
16. Test code deserves the same respect as
production code!
(Rodney
Dangerfield, a
comedian whose
tag line was “I
don’t get no
respect… )
19. Testers are especially good at…
Eliciting examples
Turning them into tests
Ensuring the right testing
gets done
Exploratory testing
19
Copyright 2012: Lisa Crispin
22. Experiment: Iteration 1
Pair up: one will be tester, one programmer
Sit back to back so you face away from each
other
Tester gets a drawing which needs to be
replicated
Tester tells the programmer what to draw, all at
one time.
Programmer draws the shapes based on what
the tester explained.
No talking during „coding‟!
Tester “tests” the drawing, reports “bugs” on
index cards
Programmer fixes the “bugs”
How long did it take? Will the customer be 22
happy? Copyright 2012: Lisa Crispin
23. Experiment: Iteration 2
Collaborate!
Tester tells programmer what to draw, watches
the programmer draw, answers questions, points
out „defects‟ for programmer to fix immediately
(Don‟t show the programmer the drawing, that
makes it too easy, we‟re trying to simulate real
coding)
How long did it take? Will the customer be
happy?
Thanks to the members of the agile-games group and
Kane Mar for ideas & pictures for this game
23
Copyright 2012: Lisa Crispin
29. Under-commit
Plan less work than you think you can do
Including all test automation
Copyright 2012: Lisa Crispin
30. Learn to write maintainable tests
Get over the “hump of pain”
From Gerard Meszaros’
XUnit Test Patterns
30
Copyright 2012: Lisa Crispin
31. Whole-team software development
Create a Expand
user tests –
story Story
Tests
Automate
Write Q2 Tests Pair,
Customer Start “Show
(Q2) thinking Me”
Tests how to
code
TDD
Exploratory
testing
Product owner
Product owner/ Tester
Tester
Tester/Programmer
Programmer Customer
User
Acceptance
31
32. Exercise
•Think of an experiment to get your
whole team engaged in automating
tests
•Share with your table group
•Pick two to share with the class
Copyright 2012: Lisa Crispin
33. Getting Over the Hump
The test automation pyramid
The agile testing quadrants
What should be automated
What shouldn't
Difficult areas
33
Copyright 2012: Lisa Crispin
37. What Should We Automate?
Quadrant 1 tests
Unit, component, TDD
Quadrant 2 tests
API, service-level
Quadrant 4 tests
Load, performance, stress
Quadrant 3 tests?
Leverage automation where useful
37
Copyright 2012: Lisa Crispin
38. What Shouldn‟t We Automate?
Quadrant 2 tests
Wizard of Oz, prototyping
Quadrant 3 tests
Usability, UAT, ET
Tests that will never fail?
Assess risk
ROI not enough
One-off tests
38
Copyright 2012: Lisa Crispin
39. Where Should We Be Careful?
GUI tests
Watch ROI
End-to-End tests
Push testing down to lowest level
Remember the Pyramid
39
Copyright 2012: Lisa Crispin
40. Hard to Automate?
Legacy code
Hard to automate, or just lack of skill?
“Working Effectively with Legacy Code” –
Feathers
“Strangling” – Fowler, Thomas
40
Copyright 2012: Lisa Crispin
42. Agile Automation Strategy
What hurts the most
Layered approach
Applying agile principles
Small chunks/thin slices
Smart test design
Choosing the right tools
42
Copyright 2012: Lisa Crispin
43. What Hurts the Most
Use retrospectives
Keep an impediment backlog
43
Copyright 2012: Lisa Crispin
45. Simplicity
Address one or two needs at a time
Understand the problem first
Try simplest approach first
Work in small chunks, thin slices
Incremental & iterative
45
Copyright 2012: Lisa Crispin
46. Automate a Slice at a Time
Example: 4-step UI to validate, upload profit
sharing contribution data
• Thread 1: All four pages with navigation
• Thread 2: Select year, enter description on page
1, display on page 2, browse and upload file on
page 2
• Thread 3: Validate data in file, display on page 3
• Thread 4: Persist data, display „success‟
message on page 4
46
Copyright 2012: Lisa Crispin
48. Exercise: Thin Slices
Here‟s our user story:
As an internet shopper, I want to create an
account so that I do not have to enter my address
and billing information each time I make a
purchase
Draw a mind map for this story on a big sheet of
paper
Identify a basic end-to-end slice of functionality
that can be coded, tested, and automated.
If you have time, identify additional slices.
48
Copyright 2012: Lisa Crispin
51. Iterative Feedback
Spike two different approaches
Pick one to try for N # of iterations
Use retrospectives to evaluate
51
Copyright 2012: Lisa Crispin
52. Learn by Doing
Courage – don‟t be afraid to fail
Production code practices for test code
Incremental, thin slices
Experiment
52
Copyright 2012: Lisa Crispin
54. Choosing Tools
Team effort
Time
Requirements
Focus on goals, problems, not tools.
Experiment
54
Copyright 2012: Lisa Crispin
55. Understand the Purpose
Who‟s using the tests? What for?
What‟s being automated?
Existing tools, environment
Who‟s doing what for automating?
55
Copyright 2012: Lisa Crispin
56. What Fits Your Situation
• Existing skills
• Language of application under test
• Collaboration needs
• What‟s being automated
• Life span, future use of tests
56
Copyright 2012: Lisa Crispin
57. Test Drivers/Frameworks
Automation layer
Fit for everyone on team
Try out more than one
Let‟s look at more examples
57
Copyright 2012: Lisa Crispin
58. Where To Find Tools
www.softwareqatest.com/qattls1.html
www.testingfaqs.org
www.opensourcetesting.org
awta.wikispaces.com/2009ToolsList
groups.yahoo.com/group/agile-testing
http://bit.ly/AgileTestTools - aa-ftt spreadsheet
58
Copyright 2012: Lisa Crispin
59. Example: My Team‟s Tool Choices
• IntelliJ Idea
• Jenkins, ant, Maven
• JUnit
• FitNesse
• Canoo WebTest
• Watir
• JMeter
• Selenium 2.0 / WebDriver with Geb framework
59
Copyright 2012: Lisa Crispin
61. Making Test Automation Work
Time to do it right
Learning culture
Testable architecture
Test data
Managing tests
61
Copyright 2012: Lisa Crispin
62. Time To Do It Right
Limit scope, don‟t over-commit
Write automation task cards
Quality must be team goal
Long-term, will let you go faster
62
Copyright 2012: Lisa Crispin
63. Learning Culture
OK to make mistakes
Lots of small experiments
Slack
Evolve right design
63
Copyright 2012: Lisa Crispin
64. Testable Architecture
• Layered architecture
• eg. UI, business logic, data access
• Ports and Adapters pattern
• App can work without UI or database
• Ports accept outside events
• Adapters convert for human or automated
users
64
Copyright 2012: Lisa Crispin
65. Test Data
Avoid database access when possible
Setup/Teardown
Independent, rerunnable tests
Canonical data
Refresh before each test run
Customizable data for ET
Production-like data
Get customers to provide example data
65
Copyright 2012: Lisa Crispin
67. Tests as Documentation
Understandable
Who will really use them?
Once passing, must always pass
67
Copyright 2012: Lisa Crispin
68. Any Example Can Become a Test
68
Copyright 2012: Lisa Crispin
69. Given/Then/When Example
Scenario: Valid name search returns results
GIVEN that Kant is a supervisor with employees
AND Kant has an employee named Smith
WHEN Kant navigates to the employee name
search page
AND enters the value “S”
THEN Kant will see a search result that includes
Smith
69
Copyright 2012: Lisa Crispin
72. Test Management Tools
Manage tests, code together
Some tools have own management
What problem are you trying to solve?
72
Copyright 2012: Lisa Crispin
78. Agile Testing: A Practical Guide for Testers and Agile
Teams
By Lisa Crispin and Janet Gregory
www.agiletester.ca
Copyright 2012: Lisa Crispin
78
79. Experiences of Test Automation
Dorothy Graham and Mark Fewster
Copyright 2012: Lisa Crispin
79
80. Beautiful Testing: Leading Professionals Reveal How
They Improve Software
Edited by Tim Riley, Adam Goucher
Includes chapter by yours truly
Copyright 2012: Lisa Crispin
80
81. Test Patterns
Xunit Test Patterns: Refactoring Test Code
By Gerard Meszaros
Copyright 2012: Lisa Crispin
81
82. Specification by Example
How successful teams deliver the right
software
Gojko Adzic
Case studies from > 50 teams
82
Copyright 2012: Lisa Crispin
Copyright 2008 Janet Gregory, DragonFire
83. Agile Test Automation Resources
dhemery.com/pdf/writing_maintainable_automated_accep
tance_tests.pdf
lisacrispin.com
janetgregory.ca
gokjo.net
exampler.com
agile-testing@yahoogroups.com
testobsessed.com
testingreflections.com
pairwith.us
83
Copyright 2012: Lisa Crispin