Downloaded 40 times
More Related Content
Similar to Introduction to Agile Testing
Introduction to Agile Testing
- 1. Introduction to Agile Testing RadButalid, ICP-ACC, CKC, PMI-ACP, SAFe SA Sept 18, 2019
- 2. • IBM RecognizedAgile Thought Leader, Agile Coach & Agile Champion • International Consortium for Agile - Agile Certified Coach (ICP-ACC) • International Business and Quality Management Institute – Certified Kanban Coach (CKC) • Project Management Institute – Agile Certified Professional (PMI-ACP) • Scaled Agile Framework – SAFe Agilist (SA – Incoming) Hello!
- 3. Agenda o What isAgile Testing? o Testing Methods and Models o What’s next for Agile Testing? o Q&A
- 4.
- 5. “Agile development has alwayscentered around testing and quality. That characteristic drew us to agile: Test first, test all the time, build in quality. ” – Lisa Crispin & Janet Gregory
- 6. 6 What is Agile Testing? Agiletesting is a software testing process that follows the principles of Agile Software Development. It is a continuous process rather than being sequential. Both development and testing activities are concurrent unlike the Waterfall model. The common objective of agile development and testing is to achieve a high product quality.
- 7. Agile Testing Principles o TestDriven: Test First vs. Test Last o Continuous Testing = Continuous Progress o Tests performed by the whole team o Continuous feedback o Decrease time of feedback response o Bug fix within iteration o Lightweight documentation 7
- 8. Advantages of Agile Testing oIt saves time and money o Agile testing reduces documentation o It is flexible and highly adaptable to changes o It provides an easier way for receiving regular feedback from the end user o Better determination of issues through daily standups/meetings 8
- 9.
- 10. Agile Test Plan oThe scope of the testing o Consolidating new functionalities to be tested o Types of testing/Levels of testing o Performance & load testing In agile testing, the test plan is written as well as updated for every release. A test plan in agile includes: 10 o Consideration of infrastructure o Risks Plan o Planning of resources o Deliverables & Milestones
- 13.
- 14.
- 16.
- 18.
- 20.
- 21. Behavior Driven Development (BDD) 21 oWho is it for? The BDD methodology is ideal for teams that work on feature- focused software and/or teams that put the user experience first. BDD starts with a functional specification using the Gherkin Given/When/Then syntax.
- 22. How is itdifferent from standard Waterfall testing? 22 o Waterfall testing requires test cases to be written early against requirements and calls for those tests to be executed toward the end of the development cycle. With BDD, tests are not based on requirements (but on “end user behavior”) and testing happens in conjunction with development of the features.
- 23. What does adoptionentail? 23 o It requires a BA to write tests up front and for the developers to write the test specification in code to match. It’s a new type of coordination within the team, but it’s extremely positive in that the team works together as one unit, business users included.
- 24. Best Practices 24 o Streamliningdocumentation in order to keep the entire process lean o Embracing a “three amigos” model where the product owner, developer and tester form a cohesive team o Using a test framework like Cucumber to define criteria o Building automated tests in a way that make them easy to reuse as much as possible o Having business analysts learn the Gherkin syntax and write test cases directly
- 25.
- 26. 26 o Who isit for? Due to its emphasis on user perception, it’s best suited for teams that are focused on the user experience, have goals around high rates of adoption and want to minimize the number of feature changes in future releases. Acceptance Test Driven Development (ATDD)
- 27. 27 o Standard Waterfalltesting calls for test cases to be written upfront based on requirements, whereas ATDD is not a requirements driven testing process. How is it different from standard Waterfall testing?
- 28. 28 o To bein the best position to adopt an ATDD methodology, teams need to get stakeholder buy-in, which can prove challenging at times. What does adoption entail?
- 29. 29 o Interacting closelywith customers, in order to determine expectations o Leaning on customer-facing team members, to understand customer expectations o Developing acceptance criteria based on customer expectations o Prioritizing two questions: 1. Will customers use the system if it does X? 2. How can we validate if the system does X? Best Practices
- 30.
- 31. 31 o Who isit for? Best suited for teams that are under time constraints, teams that need help identifying the best types of tests to run and those who want to make sure they didn’t miss anything from previous tests. Exploratory Testing
- 32. 32 o Exploratory testingcan actually be done in both Waterfall and Agile environments, but the tight integration between testers and developers in an “Agile” environment helps ease any bottlenecks that might surface while running exploratory testing in a “Waterfall” environment. How is it different from standard Waterfall testing?
- 33. 33 o It’s importantto keep in mind that it should not be the only form of testing (rather, it should inform what type of testing happens next). Additionally, even though it’s unscripted, exploratory testing should not be unstructured (testers still need to set a goal, log your activities and take on the mindset of a specific user persona). What does adoption entail?
- 34. 34 o Organizing thefunctionality in the application using something like a Mindmap or a spreadsheet o Focusing on certain areas or certain scenarios o Tracking what gets tested to help reproduce any errors o Documenting results for accountability on what got tested Best Practices
- 35.
- 36. 36 o Session basedtesting builds on exploratory testing by providing more structure. o Session based testing should be capped off with a “debrief” between the tester(s) and the manager that covers the five PROOF points: What happened (Past), What was achieved (Results), What got in the way (Obstacles), What still needs to be done (Outlook) and How does the tester feel about it (Feelings). Session Based Testing
- 37. 37 o The sameas exploratory testing, session based testing can be run in both Agile and Waterfall environments, but it is more conducive to the tight collaboration between testers and developers that is typically found in Agile environments. How is it different from standard Waterfall testing?
- 38. 38 o For testersalready accustomed to exploratory testing, the biggest hurdle is embracing the additional structure for which session based testing calls. o Similar to exploratory testing, teams running session based testing should remember that it is not a final stop, but rather a method to help determine the best type of testing to conduct next. What does adoption entail?
- 39. 39 o Outlining amission so that testers are clear about the software they’re testing o Developing a clear charter that indicates the mission, the areas of the software to test, which tester(s) will run the session, when the session will take place and for how long, the tests designed and executed, the bugs found and overall notes. o Running the testing session without any interruptions o Clearly documenting activities and notes during the session in a session report o Holding a debrief between the tester(s) and the manager to review findings from the session and discuss next steps for testing Best Practices
- 40. What’s next for AgileTesting? 40
- 41. 41 In the future,three key tenets will become particularly important for testers working in Agile environments: 1.) Communication Agile requires a tight collaboration between testers and developers, and that collaboration makes communication a top priority for testers. 2.) Skill Diversity In an Agile environment, everything can change on a dime, and that requires testers to be adaptable. 3.) Business Mindset Finally, Agile takes on a very customer-centric approach in order to ensure customers receive as much value as possible as quickly and as early on as possible.
- 42. 42 Although Agile hasalready made significant inroads into the software development lifecycle, there’s still a long way to go, especially among testing teams..
- 43. × “Lots ofmethodologies have come and gone, paradigms have changed but the requirements are always the same; Make it good and make it fast.” - Anonymous 43
Editor's Notes
- #6 As the complexity of software development process is increasing continuously, the software testing approaches needs to evolve to keep up with the development approaches. Agile testing is a new age approach which focuses on testing smarter rather than putting a lot of efforts yet delivers high-quality products.
- #7 “Agile testing is a software testing process that follows the principles of Agile Software Development.” Agile testing aligns with iterative Development Methodology in which requirements develop gradually from customers and testing teams. It is a continuous process rather than being sequential.” Which means that the testing begins at the start of the project and there is ongoing integration between testing and development. “Both development and testing activities are concurrent unlike the Waterfall model.“
- #8 Testing is continuous: Agile team tests continuously because it is the only way to ensure continuous progress of the product. Continuous feedback- Agile testing provides feedback on an ongoing basis and this is how your product meets the business needs. Tests performed by the whole team: In a traditional software development life cycle, only the test team is responsible for testing but in agile testing, the developers and the business analysts also test the application. Decrease time of feedback response: The business team is involved in each iteration in agile testing & continuous feedback shortens the time of feedback response. Simplified & clean code: All the defects which are raised by the agile team are fixed within the same iteration and it helps in keeping the code clean and simplified. Less documentation: Agile teams use a reusable checklist, the team focuses on the test instead of the incidental details. Test Driven: In agile methods, testing is performed at the time of implementation whereas, in the traditional process, the testing is performed after implementation.
- #15 Back in 2003, Brian Marick published an influential series of articles on agile testing. He was attempting to point the way forward for agile testers. But, in the process, he came up with an elegant method of cataloguing testing methods that has become known as the “Marick Test Matrix.”
- #16 Marick’s work categorized tests by asking two questions: Is the test business facing or technology facing? Does the test support programming or critique a product?
- #18 The Agile test (automation) pyramid was introduced by Mike Cohn in his book ”Succeeding with Agile”, back in 2009. The model splits types of testing into three layers based on the return on investment (ROI) offered by automating that particular type: Unit tests involve testing small units of code. They are the least expensive to write and maintain, and they provide value to the team multiple times per day. Integration or Acceptance tests, provide the next greatest benefit with User Interface testing having the least.
- #20 DevOps shift-left testing is an approach to software and system testing in which testing is performed earlier in the software lifecycle, with the goal of increasing quality, shortening long test cycles and reducing the possibility of software defects making their way into production code. One way that DevOps teams do Shift Left testing is by shifting integration testing to the left of its usual position in the delivery pipeline so that it occurs as close as possible to the build process. This allows teams to receive feedback on code quality faster, with more accurate results.
- #22 “BDD starts with a functional specification using the Gherkin Given/When/Then syntax”… This specification then guides developers, testers and product owners who move across features. As they do, they use automated test functions to determine completeness, refining code until it passes the test, much like in the TDD approach except at the team level.
- #23 Additionally, within a Waterfall methodology, testers are the ones writing the test cases. A BDD approach, on the other hand, lends itself to the business owners writing the tests. This switch reduces communication (or miscommunication) between the business analysts, developers and testers
- #24 Read first: Changing to a BDD methodology can be challenging when the team is used to a traditional style of testing. (read content sparsely afterwards)
- #27 The idea behind ATDD is that user perception of the product is just as important as functionality, and should drive product performance in order to help increase adoption. ATDD collects and uses input from customers to develop acceptance criteria, translates that criteria into manual or automated acceptance tests and then develops code against those tests.
- #28 Read First: ATDD is different because it is a test-first methodology.. (read content sparsely afterwards)
- #29 Read First: Because ATDD represents such a departure from traditional methods, going from one to the other isn’t easy for teams to do.. (read content sparsely afterwards)
- #30 Interacting closely with customers, for example through focus groups, in order to determine expectations Leaning on customer-facing team members, such as sales representatives, customer service agents and account managers, to understand customer expectations
- #32 “teams that need help identifying the best types of tests to run”… (especially in cases where there are no specifications from developers) Exploratory testing can help reduce time spent testing, find more defects and improve code coverage. Because of its unscripted approach, exploratory testing often mimics how users will interact with the software in real life.
- #34 READ FIRST: Embracing exploratory testing is relatively easy, as it is quick to launch (and scale), simple to learn and provides benefits for the entire team. That said, “it’s important to keep in mind..”
- #37 “Session based testing builds on exploratory testing by providing more structure.” It provides this structure by conducting testing during time-boxed, uninterrupted sessions, testing against a charter and requiring testers to report on the testing that took place during each session.
- #39 READ FIRST: Much like with exploratory testing, adopting session based testing proves relatively easy because it is easy to pick up and launch quickly. “For testers already accustomed..”
- #42 1.) Additionally, in a world where quality becomes everyone’s responsibility, testers will become “quality champions” that serve as internal experts, which will put their ability to clearly communicate testing needs and reasoning under the spotlight. 2.) Part of this adaptability is having a diverse skillset so that testers can change course as needed. For instance, functional testers need to expand their skills beyond manual scripted execution. This diverse skillset will be a must as different sprints require different types of testing to be executed in a short timeframe 3.) Testers have a big role to play in delivering this value, but it requires them to take on a business mindset so that they can understand customer expectations, desires and concerns and develop their testing strategies accordingly.
- #43 Going forward, more widespread adoption and greater maturity of Agile methodologies will require testers to go beyond test creation and execution and begin to focus on code delivery and integration too. At the same time, testers will need to hone their automation skills, become more involved in the entire software development process and continue to develop a collaborative relationship with developers. Ultimately, these changes will also require testers to become experts at development and product usage in order to provide more holistic testing strategies and take on the role of “quality champions.”