Model-Based Testing for ALM Octane: Better tests, built faster
•Download as PPTX, PDF•
0 likes•190 views
Slides from webinar, co-hosted by the Vivit UK & Ireland Local User Groups on May 27th 2020. James Walker from Curiosity Software Ireland presented on model-based testing for ALM/Octane, setting out how model-based testing enables greater communication, collaboration and end-to-end automation. For many organizations today, ALM Octane provides the single source of truth for distributed teams. Its scalable test management keeps testers and developers synchronised with granular analysis of testing progress and results, all integrated into CI/CD pipelines and agile methodologies. However, the quality of this testing remains dependent on the quality of the tests fed in and assigned to testers. Testing speed furthermore remains limited by the efficiency of that test creation. Manual, unsystematic test design and a reliance on low-coverage production data will still lead to low coverage tests. Those tests will also remain impossible to maintain in tight iterations, leaving new releases further exposed to damaging bugs. Impeccable test management instead deserves impeccable test design. This webinar demonstrated how model-based test generation seamlessly maintains optimized test cases and data in ALM Octane, all linked to system requirements and automation frameworks for in-sprint maintenance and test execution. You will discover a requirements-driven approach to test maintenance, in which test cases, scripts and data are maintained as quick-to-build flowcharts are updated. Powerful mathematical algorithms generate the smallest set of tests needed to “cover” the latest system logic, with “just in time” data allocation to ensure that every test has valid test data. Pushing the tests to integrated automation frameworks enables truly “Continuous Testing”, with granular run results synchronized automatically in ALM Octane.
Recommended
More Related Content
What's hot
What's hot (19)
Similar to Model-Based Testing for ALM Octane: Better tests, built faster
Similar to Model-Based Testing for ALM Octane: Better tests, built faster (20)
More from Curiosity Software Ireland
More from Curiosity Software Ireland (14)
Recently uploaded
Recently uploaded (20)
Model-Based Testing for ALM Octane: Better tests, built faster
- 1. Model-Based Testing for ALM Octane presented by the United Kingdom & Ireland LUGs
- 2. delivered and presented to you by the Vivit UK & Ireland LUGs and Curiosity Software Ireland CuriositySoftware.ie Local User Group UK Local User Group Ireland Welcome to this Vivit LUG Webinar
- 3. Vivit LUG UK & IRELAND The primary areas of interest for both Local User Groups (LUG) in UK and Ireland are: ADM, ITSM and Security. A number of meetings will be held each year, generally in the Dublin and London region, where we encourage users to present their experiences and insights on deployment of Micro Focus technology. Knowledge sharing and networking are the core principles for the group. • We addresses : organizational, methodological, and technical questions surrounding the application of products like • ALM Software / Quality Center Enterprise • ALM Octane • UFT Fosters experience sharing among users Communicates feedback to Micro Focus
- 4. What Vivit Means to You Community Advocacy Education Career Development
- 5. Today’s Speaker James Walker Director of Technology Curiosity Software Ireland James.Walker@Curiosity.Software linkedin.com/in/automationjames calendly.com/curiosity-james
- 6. House Keeping • This “LIVE” session is being recorded Recordings are available to all Vivit members • Session Q&A: Please type questions in the Questions Pane
- 7. Webinar Control Panel Toggle View Window between Full screen/window mode. Questions
- 8. © Curiosity Software Ireland Ltd. 2020 Model-Based Testing for ALM Octane 1. Using ALM/Octane and MBT to unlock Continuous Testing 2. Demo: Using ALM/Octane and MBT for BDD 3. Questions and discussion
- 9. © Curiosity Software Ireland Ltd. 2020 Using ALM/Octane and MBT to unlock truly Continuous Testing
- 10. © Curiosity Software Ireland Ltd 2020 2020: Siloes/Information Hops perist Silo ‘Agile’, Continuous Testing, “DevOps”… Or mini-waterfalls? Wall Information Hop Delay No feedback or traceability Dev Automation EngineersQA/TestBAs Effort: Repetitious. Flat” formats prevent automation in QA & Dev. Quality:Most bugs originate in incomplete, ambiguous requirements. Effort: Re-coding after misunderstood designs and uncaught bugs. Quality:Bugs are more damaging the later they are discovered. Effort: Slowly create and maintain 1000s of test cases. Wait for data. Quality:Manually derived tests hit a fraction of system logic. Effort: Repetitious scripting, growing maintenance. Quality: Data clashes, false positives, false negatives, low coverage. Formulate complex requirements and change requests in disparate, unconnected formats. Convert the incomplete designs into code, trying to fix the impact of changes on complex systems. Unsystematically create high volume, low coverage test cases, mismatched with system designs. Choose between creating new scripts for new logic or maintaining existing code.
- 11. © Curiosity Software Ireland Ltd 2020 Model-Based Automation Recorded tests activity Test Cases BPMN diagrams BDD Scenarios Business Requirements Application Scans Reactive Model of the system Find / Make / Allocate Test Data Run Results Tests New Iteration Perfect sets of tests Fast Maintenance Reusable Components Move faster Deliver with confidence Test AutomationTest Automation
- 12. © Curiosity Software Ireland Ltd 2020 Development Automation Engineer QA/TestBA Agreement Feedback Agreement Feedback Agreement Feedback Agreement Feedback Data Change Requests Gherkin Automation Modules Maintain frameworks Subflows Negative Logic Data Accurate Specifications and change requests Precise bug reports A better system developed first time round Mobile and web Thick client API DB Run Results Cross-functional/feature team members with additional skills in integration and CI/CD “Shift left” to maintain rigorous test assets at the speed of system change For the effort of creating a flowchart, you can rapidly auto-generate all test assets needed in automation: Optimised test cases Test Scripts “Just in time” Data Virtual services Continuous Test Execution Parallel, un-siloed development Automation, Collaboration, Acceleration
- 13. © Curiosity Software Ireland Ltd 2020 Seamless collaboration: Flowcharts pool knowledge and skills The models then automate the creation test assets and specifications, driving accurate development and in-sprint testing Skills sharing & cross-team collaboration: People who understand the user requirements People who understand testing People who understand automation People who understand data People who understand integration People who understand CI/CD A single source of truth for all assets Test scripts Test Cases Written Requirements & Diagrams Gherkin specifications Test Data Service Definitions & Virtual Services Cross-team alignment & real-time communication • No technical debt • In-sprint automation • Minimal dev rework • Avoid duplicate effect and cumbersome maintenance
- 14. © Curiosity Software Ireland Ltd 2020 A shared vision. Critical modelling as Design Thinking. Most bugs stem from requirements. Miscommunication create rework. • Collaboratively modelling provides continuous feedback – each tester, dev, BA spots things the others didn’t. • Logical modelling forces us to act as critical modellers – it eradicates ambiguity as we must pick only one option. • Visual models make it easy to spot incompleteness upfront. From complete, agreed and precise models, we provision accurate specifications to Dev and generate tests to validate their code. Behaviour-Driven Scenarios ChatOps and Oral Agreements “Flat” diagrams Requirements Documents Emails Spoken Agreements Requirements are often spread over unconnected formats. Modelling consolidates them, spotting incompleteness & ambiguity. This “living documentation” avoids technical debt and keeps teams aligned. ⨯
- 15. © Curiosity Software Ireland Ltd 2020 In-sprint testing, no information hops. Automate test asset maintenance. Shift Left QA does the hardwork upfront. Everything ripples from the models. • Modelling automates otherwise slow and repetitious test case and data creation. • Gherkin, data, test cases, scripts, and more, are traceable back to models. • No reworking existing assets – updating the models updates the tests. • No manually converting assets from one sprint or silo to the next. • QA automatically compares the desired system to the system built in code.
- 16. © Curiosity Software Ireland Ltd 2020 The value of Visual BDD to you and your organisation Value to BAs Value to Dev Value to QA Value to automation engineers Collaboration Collaboration Collaboration • Deliver with confidence and deliver faster: Deliver rigorously tested software more frequently. Perform measurable, risk-based testing, driven by test design, data allocation, and test scripting/maintenance. • Increased software quality and reduce development rework: Rigorously test prior to every release. Achieve optimal functional coverage, detecting defects in-sprint to reduce defect remediation time and cost. • Minimise unnecessary work: Maximise re-usability to avoid duplicate effort and reduce time spent on manual processes. Minimise time and quality lost to miscommunication and moving between silos.
- 17. © Curiosity Software Ireland Ltd 2020 Demo: Using ALM/Octane and MBT for truly Behaviour-Driven Development
- 18. © Curiosity Software Ireland Ltd 2020 Create Models of Requirements Find / Make / Allocate Test Data Gherkin Tests -> Octane Glue code Import Existing Gherkin (with Example data) Scan web applications to assist with creating Page Objects Export Gherkin with Data to Octane Make / Find Test data Octane interfaces with developers IDEs to create associated automation. Automation Tests Run results Dynamic Data Tags Automation Scripts Test Data Resolved Model-Based BDD
- 19. Demo © Curiosity Software Ireland Ltd. 2020
- 20. © Curiosity Software Ireland Ltd 2020 Model-Based Testing: A one-stop-shop 1. Design: Import business-driven requirements and model the system using easy-to-use flowchart models and the UI recorder. 2. Auto-generate test cases based on time and risk – tests can provide maximal coverage or new and critical functionality can be emphasized. 3. Generate the data and virtual services needed to execute every test. 4. Execute tests across existing automation frameworks with support for web, mobile, and thick applications. 5. Feedback and reporting: update fields across files, databases, automation frameworks and ALM/Octane. 6. Automatically update tests, data, and services as the system changes.
- 21. © Curiosity Software Ireland Ltd 2020 Carry on the conversation? • Got a problem to solve or questions to ask? I’d love to chat. Book a web meeting with me at calendly.com/curiosity-james • Want to try MBT for ALM/Octane? Visit Testmodeller.io for a free trial. • Connect with me on linkedin.com/in/automationjames or follow @CuriositySoft on Twitter for MBT resources and news. • Drop me an email on James.Walker@Curiosity.Software
- 22. Questions & Answers Please type your questions in the questions pane.
- 23. Upcoming Vivit Events Keep an eye on the Vivit Community Calendar for upcoming events! May 29th, 2020 Meeting: Vivit TQA (Testing, Quality, Application Lifecycle Management) SIG - "Agile Entwicklung & Testen mit ALM Octane" From 10 AM to 11:00 AM CEST (web meeting) https://www.vivit-worldwide.org/events/EventDetails.aspx?id=1381557&group= June 9th, 2020 Meeting: New England User Group & Micro Focus - " Smarter Testing. Superior Outcomes." From 12:00 PM to 1:00 PM EDT https://www.vivit-worldwide.org/events/EventDetails.aspx?id=1373304&group=
- 24. Thank you • Complete the short survey so your Vivit leaders can better serve you in the future https://www.vivit-worldwide.org/
- 25. Thank You
Editor's Notes
- Thank you all for joining today’s webinar. This session is presented by Vivit, your independent Micro Focus Software User Community. I’m your moderator, Tom Pryce. Today, James Walker will be presenting on “Model-Based Testing for ALM Octane”.
- This webinar is presented by the UK and Ireland Local User Groups of Vivit, in conjunction with Curiosity Software Ireland. The slides will be shared after the webinar - I encourage you to click through to check out both Local User Groups and see all the great events they run.
- Both the UK and Ireland User Groups focus on Application Delivery Management, IT Service Management and Security. They organise in-person meetings, in Dublin and London, as well as virtual events. Both groups focus on organisational, methodological and technical questions. They specialise in technologies like ALM, Octane, and UFT. Joining these groups is a great way to share ideas and learn from each other. It’s also a great opportunity to communicate feedback to Micro Focus.
- If you’re already a member of Vivit, you’ll know about all the amazing work they do. It’s a fantastic community, offering both education and career development. It also does great advocacy work on behalf of its membership.
- So onto today’s speaker. It’s my pleasure to introduce my friend and colleague at Curiosity Software Ireland, James Walker. James is Director of Technology at Curiosity, specializing in model-based testing and test automation. He holds a PhD in visual analytics and today applies this expertise to crafting effect QA solutions. You can contact James via email or LinkedIn and can also use the link on screen to book a meeting via Calendly.
- Before we start, a quick bit of house keeping: Today’s live session is intended for all Vivit members. The on-demand recording, slide deck and questions will be posted on the Vivit website, visible for all members. They will also be made available to you directly – we’ll send links via email. If you have questions as we go along, please type and send them in using the Questions Pane in the webinar control panel. We’ll have a live Q&A at the end.
- Here’s where you can find the Questions Pane. Open your GoToWebinar control pane, typically found in the top-right, and type your question in the Question Pane. Then hit send. Okay, with no further ado, over to you James.
- “Continuous Testing with Models: Eradicating barriers to rigorous testing”. This title already raises the question of how we are define “Continuous Testing”, as numerous definitions exist. I will not provide a concise definition now, but will offer some preliminary premises for the rest of the session: Firstly, ‘continuous’ implies that QA activity is happening all the time. Across QA, this means teams must be able to work in parallel, free from cross-team constraints. In the context of the whole delivery pipeline, that means that QA must start from day one – it must “shift left”, as opposed to a siloed approach where testing begins only after design and development have passed on a system to test. Secondly, to test ”continuously”, I need to work seamlessly from the efforts of previous iterations. If I am having to spend time checking and manually maintaining test artifacts from previous sprints, this is preventing me from testing the new functionality. Furthermore, the amount of time required for maintenance will grow with each sprint, as the complexity of the system grows. I am then faced with the choice of focusing on new functionality, or allowing invalid tests and technical debt to grow. In neither instance am I testing rigorously, and nor is testing therefore properly “continuous” – I am testing all the time, but only because I am leaving large chunks of the system untested. Lastly, testing “continuously” for most organizations will not mean merely testing all the time and indefinitely. Testing will usually have a formal ‘end point’, defined by the length of a sprint or iteration. Continuously instead means being able to test at every stage throughout this iteration, and ideally we should be aiming to test all new functionality introduced to a system within the iteration it was introduced. Meanwhile, we need to regression test all existing functionality impacted by any changes made during an iteration, as otherwise a system is being left exposed to defects. Rigorous testing of ever-complex systems within ever-shorter sprints in turn demands a greater degree of automation, being able to take software from design to testing seamlessly within six weeks, for instance. This preliminary remarks have therefore introduced a few principles of Continuous Testing that will run throughout this session. Namely parallelism, an unsiloed approach, shift left testing, the Don’t Repeat Yourself” or “DRY” Principle, and a fully automated pipeline.
- Brilliant, thank you for the interesting presentation and demo James! We’ll now have a live Q&A – if you have any questions, please do type them in the Question Pane of the Go To Webinar Control Panel.
- Please do keep an eye on the Community Calendar for future events. The UK and Ireland Local User Group are ourselves working towards a virtual Octane roundtable and in-person user groups. So please keep an eye on the Vivit website for more information! Here are two upcoming evens that might be of interest to you – First a German speaking virtual event on the 29th, brought to you by the Testing, Quality and Application Lifecycle Management Special Interest Group. That one will focus on Agile Development and testing with ALM/Octane. Secondly, the New England User Group and Micro Focus are presenting an event on June 9th. That will focus on “Smarter Testing. Superior outcomes.”
- We’d love to hear from you if you have any feedback about today’s session or would like to help steer the direction of future events. If you are in the UK and Ireland, you will receive a survey specifically about the future events held by these Local User Groups. Please do take the time to fill it out and we’ll create the events you want! Everyone will receive a short survey after the webinar ends – we’d love to hear your feedback! Thank you for attending today’s Vivit TQA SIG webinar! Just a reminder that the on-demand recordings and slide deck will be posted to the Vivit website. In the next few days, you will receive an email with those links.
- Thank you James and thank you everyone for joining!