Agile Testing Days -the Challenges Ahead
•Download as PPTX, PDF•
0 likes•1,041 views
The document discusses challenges that will influence the way testing work is done in the future. It highlights trends like test automation, continuous integration and deployment, changing technical and business knowledge needs, and working in multi-disciplinary teams. The keynote speakers will discuss these challenges and provide guidance on how testers can prepare for them. They will also recommend sessions in the ATD2019 conference program that can help attendees prepare for these challenges and trends.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Agile Testing Days -the Challenges Ahead
Similar to Agile Testing Days -the Challenges Ahead (20)
More from Derk-Jan de Grood
More from Derk-Jan de Grood (20)
Recently uploaded
Recently uploaded (20)
Agile Testing Days -the Challenges Ahead
- 1. Software testen Business Process Transformation Security testen Specialisten in vooruitgang The challenges ahead Our world will keep on changing, you better be prepared
- 2. The challenges ahead Abstract The world of testers has been changing a lot in the last 10 years. And the change continue in an ever increasing speed! In this pre-conference keynote Derk-Jan de Grood and Jan Jaap Cannegieter will highlight changes and trends that will influence the way we do our work.This will introduce challenges for testers, today and in the next few years.The challenges are related to for instance test automation, Continues Integration and Deployment, technical and functional knowledge, how to deal with (senior) management, working in multi- disciplinary teams and organisations that change their business model. During this pre-conference keynote you will be informed and challenged.Which knowledge do you need to develop yourself and prepare for the future. Derk-Jan and Jan Jaap will discuss how you can prepare for these challenges and will provide a guide into the ATD2019 program. Get the most out of this conference and attend the sessions that are most helpful to prepare for these challenges. 2
- 4. The challenges ahead 4 Goals for today Get an overview of the trends that influence the testing profession Create an awareness of the challenges that lay ahead
- 5. The challenges ahead Who we are… Derk-Jan de Grood Jan Jaap Cannegieter Consultant – Thoughtleader– Writer Testing – Agile Coach Consultant – speaker – Writer Testing – requirements – Agile
- 6. The challenges ahead Our sources Experience The ATD 2019 Program Internet State ofTesting report 2019 6
- 8. The challenges ahead How innovate are we? Stand up – sit down Domitica – e.g. light controlled by phone, electronic key to your front door, home assistant? Who doesn’t have a wallet anymore since apple pay / e-wallet? Who has the latest iphone IOS (IOS 12) or android version (version 10)? Who only uses software in the cloud in stead of local installed? So, how innovative are we? 9
- 9. The challenges ahead 10 2011 Keynote by James Witaker
- 11. The challenges ahead 12 Don’t be innovative But be adaptive What things should I adopt & learn?
- 13. The challenges ahead Buzzword Bingo Augmented reality Domotica Big data Internet ofThings Robotic Process Automation Artificial intelligence Block chain Geo Spatial Human Computer Interaction Data lake Virtual reality Machine learning MicroServices Edge computing Cloud computing Chat bots
- 14. The challenges ahead 15 Real innovation is in the mix of technologies
- 15. The challenges ahead Stand out from the crowd
- 16. The challenges ahead E.g. Lemonade 17
- 17. The challenges ahead What makes our app really successful? 18
- 18. The challenges ahead How do we test ... new technologies ? 19[Source: Sogeti- Sander Duivenstein/Michiel Boreel]
- 19. The challenges ahead On the ATD program…How do we test 20 14%
- 20. The challenges ahead And ones that make us curious… 21
- 21. The challenges ahead 22 Technology driven developments
- 23. The challenges ahead On the ATD Program… 24 Should we discus other compliancy standards as well 4%
- 25. The challenges ahead Thinking in Value Streams and customer journeys 26
- 26. The challenges ahead 27 Focus on individual teams
- 28. The challenges ahead On the ATD Program 29 Not much on scaling on the program
- 30. The challenges ahead 31 Oh yes, we take quality very seriously.We run over a 300 automated tests every day
- 31. The challenges ahead On the ATD program: Automation…. 32 …and tools 10%
- 33. The challenges ahead Test knowledge decreasing Nobody asks for testing Test hardly part of DoD
- 34. The challenges ahead 35 Proud to be a tester
- 35. The challenges ahead On the ATD program…Ownership of Quality 36 5%
- 36. The challenges ahead 37 Multi functional professional
- 37. The challenges ahead 38 15% 10% 8% 7% 7% 6%5% 4% 4% 4% 3% 3% 2% 2% 2% 2% 2% 1% 1% 1%1%1%1%1%1%1%1%1%1%1%0%0%0%0%0%0%0%0%0%0%0%0% Pi shaped professionals - Expertises Test automation Programming Requirements management Domain knowledge Scrum master (Agile at Eurostar) Trainer / test consultant End-to-end testing Usability testing Risk management Performance testing Cultural host DevOps Security testing System integration Project management Cloud Integration and deployment specialist Mobile specialist IoT specialist Documentalist Regression testing Functional design Logging specialist Test environment manager Quality manager Auditor Product owner Hardware tester Embedded specialist
- 38. The challenges ahead On the ATD Program…Become a better tester 39 11%
- 39. The challenges ahead On the ATD Program…Learning 40
- 42. The challenges ahead 43 Model driven code generation CI/CD Self healing code Generated design AI/ML Production Monitoring
- 43. The challenges ahead 44 Model driven code generation CI/CD Self healing code Generated design AI/ML Production Monitoring
- 47. The challenges ahead 48 How to Test… 14% Learning 11% Automation 10% Agile 7% Agile Leadership 7% Human side 7% Dev practices & tools 7% Team aspects 7% Miscellaneous 5% Ownership of quality 5% Audit, Complience and Governance 4% Test strategy 4% Testing on PRD 2% On the ATD 2019 Program How to Test… Learning Automation Agile Agile Leadership Human side Dev practices & tools Team aspects Miscellaneous Ownership of quality Audit, Complience and Governance Test strategy Testing on PRD Communication Gamification Stakeholders Coaching Context, testing in type organisation Exploratory testing Future prediction Test Effectiveness Pick and Mix your topics !
- 48. The challenges ahead Success with keeping up! 49
Editor's Notes
- DJ
- DJ / JJ Explain with two lively examples that there is an urgency
- JJ So the advantages of attending this session is that You get more out of this conference You prepare for the future career
- DJ - JJ
- JJ
- JJ
- DJ - JJ Questionnaire : lets check how adoptive you are Stand up Ask the audience if they adopted: Domitica – e.g.Ligths controlled by phone, electronic key to your front door, home assistant? Who doesn’t have a wallet anymore since apple pay / e-wallet? Who has the latest iphone IOS (IOS 12) or android version (version 10)? Who only uses software in the cloud in stead of local installed?
- DJ James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011 https://www.slideshare.net/EuroSTARConference/k3-pursuing-qualityyouwontgetthere-james-whittaker Message: James lists some improvement that made s/w better: Why software is better ... Immediate cost of low quality Competition 15. Why software is better ... Post-ship bug fixing Auto update 16. Why software is better ... Self repairing software Crash recovery 17. Why software is better ... Goodbye server config Cloud deployment 18. Why software is better ... Reduction of dependencies Standards 19. Why software is better ... Elegant programming languages Languages 20. Why software is better ... Eradication of certain bug species Extinction 21. Why software is better ... Better code management Initial code quality 22. Why software is better ... Continuous build/integration/release/test No More Big Bang 23. Why software is better ... Convergence of the user and test community Crowd Source And ask what testing contributed to this innovations… Only to make a statement , that none of it came from testing …. How innovative do we want to be.
- How innovative do you want our profession to be? Where do you stand yourself… Example: KPN declared in 2006: “we are no longer innovative, but we aim to make proven technology accessible for the masses” It’s is a interesting statement, since it shows that the level of innovation is a business decision. If you look at the graph it shows that if you are an innovator you are reaching out for <10% of the market. So what does the testing profession need to be?
- https://www.youtube.com/watch?v=D5VN56jQMWM
- Trend There is a growing need for organizations to distinguish themselves and take customer experience real serious The customer is getting more critical and it is easier to compare products (on-line customer pages, Comparison sites, buying hings online) If they don’t like it they go somewhere else (e.g. Energy market and health insurance where customer renew contract on yearly basis) Response The need to distinguish the service with respect to competitors determine what items we will be working on. A New focus on customer experience in order to stand out and retain the customer (e.g. Buy a share in solar energy get a free panel when you take a 3 year contract) Have adaptive products, e.g. Insurance companies that let you turn on and of modules yourself on the website) Offer better information to the customer (e.g. Pension provider, what is done with your money inlay, Parcel handler provide detail time of delivery) Becoming cheaper and more effective (e.g. straight through processing and cost effective IT) Impact Working on other types of IT solutions UX is becoming a more important part of systems design and test (e.g accesbilty and perceived performance We discover legacy in our systems (when we want to optimize) and lack of data (when we want to provide e.g. information) We collaborate more with the business (while we want to execute automated test in the sprint, we also need business validation) Example: RDC Online marktplaats 2nd hand cars : How do you make the new site stand out in the crowd
- Source: https://www.digitalinsuranceagenda.com/138/lemonade-the-market-most-talked-about-disruptor/ Video: https://youtu.be/flSLI2JmWVE Start 1 min 8 This is an example of AI, ML and RPA Example of INSURANCE company (https://www.information-age.com/how-facial-recognition-could-save-insurance-companies-billions-123472478/), https://www.wesee.com/news/emotion-recognition-could-eliminate-insurance-fraud/
- These are topic that are on the ATD program this year….
- These are topic that are on the ATD program this year….
- Trend Need to become cheaper and more effective (cost effective IT) Response Moving to the cloud Microservices IT for IT: automate everything Impact Teams are using a lot of their time on e.g. transforming to the cloud or automation their Dev process. Teams need to gain knowledge on Cloud, CI/CD, test automation, etc Teams do not always get time for doing this due to other urgent items (e.g. compliancy and ops work) – so need to fight for their improvements Accent moves from fuctional testing of new features to infra/migration testing challenges
- JJ Trend Compliancy, governance is important by law Security Response Quality controls should be explicit and auditable Example: Bank threw away the testing policy/approach and auditors like DNB wanted some proof that testing was organized… Example: <RWS voorbeeld Jan Jaap> Example: Dutch telecom where the financial flow should be tracible over the various mobile networks – Revenue control Example: Fraud detection by financial institutions – e.g. credit card usage Example: Traceability of transactions and mutations Impact Testers need to know what controls are important and include these in the standard tests (have a word with the compliancy officer) Testers need to be able to prove that automated controls (that are embedded in the tests) are executed for each release (example SOX or Traceability of transactions and mutations) Testers need to provide an auditble process themselves (example: testers that went to the compliancy officer to discus the detail of their testlog) Testers need to know the standards like GDPR, Sox, … What on the program A Lawful Thing To Test - Han Toin Lim
- JJ
- Trend Focus on individual teams makes organization struggle with control and alignment Growing awareness that we need to think in releases, value streams and customer journeys Testing is carried out at various levels Teams become DevOps teams Response a) Growing need for metrics and progress indicators, both technically, operational as well on improvements/process Example: Agile PMO-er, as rol to manage the metrics and provide dashboards Example: Testen als quality gate voor elke stap = DOD b) Testing in the teams has to be aligned with other teams. We used to do project with a focus on releases, Early Agile resulted in a team focus, but we start to think in customer value again. Involvement of the business c) Not new of course, but in order to check the value stream effectively we need to be good in testing at UserStory level, but also at release, feature level and in production. Example of need for higher level testing: Continues deployment eliminates the physical release. But don’t we need to validate the whether we achieved our Epic or release goals Example at customer we worked with 9 component teams they were testing their system. Identifying Interfaces (40 of them) and ensuring that the e2e scenario's were working took a lot of effort, since the teams had their own focus. d) Teams become DevOps teams Impact Growing need for metrics and progress indicators – KPI/OKR’s/Factbased need to know how to contribute to these indicators and how to measure the effectiveness of the testing Developers (and testers) are involved in Design Workshops (Sprints) . Although testing needs to be done in the sprint, there is a need for quality on release level. During our tutorial we see a lot of interest in this topic (release testplan on increment or MVP level. As testers we can contribute in the shift left (and be facilitator in refinement and design workshops). Skills are needed to host sessions that e.g. result in waste and RCA of problems, Story mapping and customer journeys. Need for some form of test plan to ensure acceptance on release level Teams get involved in optimizing operational flows as well as development work. So there is an increase in focus on operational processes, and quality
- Trend DevOps is A hype Response Everyone is Devops Example: we are devops but we are not live yet? Impact How to deal with different paces of work Dev have to do Ops Ops not always trained to do dev Ops work is usurping all of the dev time What on the program <TBD>
- JJ
- Note: this is the result of workshops that we gave in 2016 at several occasions / Conferences. Now the skills would probably be more simple Test Automation Developer Engineering Coach Agile Coach Domain Expert It would probably include AI/ML, CI/CD as well
- DJ Janet: deliberate practice- how find eares of imrpvement and focus on an learning goal Mike: you lose focus when doing things moere often, how can you stay alert and objective Geoffrey and Marta: How to detect and see the smallest things to improve your software but also deduct rca
- JJ
- DJ