Your SlideShare is downloading. ×
0
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Acceptance Testing Driven Development, TDD
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Acceptance Testing Driven Development, TDD

580

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
580
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • I am delighted to share with you some thoughts Smartesting 10+ years old company: - push quality upfront with early test design - speed up test design and maintenance by a factor of ten! We are at the stone age compared to what developers do. - Testing is not a pain. This is cool and testing is THE opportunity to streamline
  • As introduction I will share with you our own experience in testing our product Then I will present the traditional testing process and the testing value chain to show you the way it s being disrupted. One of the main conclusion we ’ ve come to is that, as tester, we need a language If we still write tests as free text, we will never be able to Handle very quickly, to iterate and be agile! So not only we ’ ve come to this conclusion I will end up with the perspectives and different trends we foresee in the testing market.
  • So Let ’ s start by an interesting tweet from Alex Osterwalder The next tweet was about the disruption that ’ s happening
  • Let ’ s focus on testing. The 3 leaders (for testing tool) of this market Now let me ask you a question: where do we find the best practices? Do these guys use a test management tool? BTW how many of you use QC or RQM You can raise your hand that ’ s not a shame
  • Now let ’ s have a look at our own history as software vendor We were developing a MDT solution. So quite complex develoments… Testing was a nightmare=> Poor Quality I remember the feedback of a customer
  • So we made the decision to be more agile, do ExP, deploy scrum One of the key building block was continuous integration Doing the acceptance testing is no more a pain and and we can roll out rapidly with a good quality. So that ’ s fine. Our developers enjoy extreme programming and scrum even if there are some drawbacks to pair programming
  • we made the decision to develop a platform in the cloud Implement 3 missions: testing upfront & enabling ATDD… So we had to go one step further and do DevOps and continuous deployment (SciFi) To achieve continuous delivery of valuable software => testing has to be “ continuous We start every feature by… and I DO TEST
  • What is agility about? If we have to iterate very quicly, we don t have time to synch 3 repo: Ex, Test, Dev with 3 different owners I will mainly focus on the last 2points.
  • This is another way to see the pb. For big project we usualy have Just to mention some of the problem
  • Gartner predicted that mobile App dev will outnumber native PC projects by a ratio of 4:1 by 2015.  I will not mention in this pres: security & performance to focus on functional. Continuous testing: “ Our highest priority is to satisfy the customer through early and  continuous delivery  of valuable software.
  • An acceptance test is a formal description of the behavior of an application, generally expressed as an example or usage scenario Tests are the requirements. TEST ARE THE DEFINITION OF DONE Testing is no more the last step of the development process before moving into production, it is the first one! Focus developments efforts on acceptance tests Use acceptance tests to facilitate discussion about future change requests Brian Marick’s Agile Testing Quadrant
  • Use Test to build a shared understanding of the domain and of the objectives : YOU know what successful implementation means Focus developments efforts on acceptance tests You increase you quality and efficiently support continous delivery of valuable software
  • Accelerate the testing cycle at the business level! At smartesting we have automated 100% of our test so that we have an immediate feed-back, we can deploy de build and more importantly, we get the feed-back directly from the end user and can iterate quickly
  • So acceptance test is a formal description of the behavior of an application , formal description we use to build a shared understanding of the business domain. What we need now to be really lean is a test language. Not just free text. But Some concepts to handle. The same concepts will be used for the test automation and to do some analytics. I cannot iterate rapidly trough this loop if I have just text like in QC or Excel.  
  • Author Notes: This template has been created in PowerPoint 2003 Depending on how the source file was formatted, some slides will not ideally reformat once the template is applied. Therefore, some reformatting will be necessary. Reapply slide layouts: Task Pane / Slide Layout Can be applied thru normal or slide sorter view May have to reapply the layouts more than once in order to take effect Limit altering slide layout attributes on your slide (fonts, positioning, text box anchoring, positioning, etc.), this will create less reformatting rework when switching templates in the future or repurposing this slide in other presentations. Use “shift returns” if text wraps are needed to wrap around imagery. If slide layout customization is needed, it ’s advised to break the customized text box from the slide layout by selecting the bounding box of the altered text box and cutting it from the slide, apply either the title slide layout or the blank layout, and then paste the text box back onto the slide. Your custom-formatting of the text layout will then be retained for future repurposing in other presentations. Recolor graphics if needed by using the embedded color palette swatches already in this template. Slide text: Don ’t create long sentences or paragraphs on slides. Use concise bulleted list format. Use speaker notes for supporting bulleted content to avoid slides that are too text heavy. Use sentence case capitalization for presentation titles, slide titles, category labels and bullets: Format / Change Case / Sentence Case. Initial capitalization is limited to our products and offerings. When referring to IBM products, use the correct full name, do not abbreviate. Imagery Avoid using cartoon like clip-art, use photo-art instead. Third party material cannot be used in a presentation without written permission (this includes product and Web page screen shots). Images must be acquired from a ‘ royalty-free to use ’ source such as: Microsoft or Lotus Symphony Clip Art library http://www.freebyte.com/clipart_images_photos_icons/#freevectorgraphics http://www.freedigitalphotos.net/ IBMers can use images from IBM approved image libraries: https://w3-03.ibm.com/software/marketing/marksite.nsf/AllMarketingPages/Brand-Rational-rt_rtb?OpenDocument&ExpandSection=4#_Section2 Close each presentation with the mandatory “Rational ThankYou Slide” located in the back of this file.
  • Position the MBT Make comparison with development language
  • The needs are different compared to the dev Testing is made by some examples that helps to capture the behavior of the App
  • Smart testing tool should help me to build the right level of abstraction and factorization. Help me to build action word when I need reuse and factorization, not before, not after.
  • 2 levels is good. 3 levels becomes hard to maintain
  • Optional slide. Graphic is available in English only.
  • Testing is made by some examples that helps to capture the behavior of the App
  • Testing is made by some examples that helps to capture the behavior of the App
  • Testing is made by some examples that helps to capture the behavior of the App
  • Author Notes: This template has been created in PowerPoint 2003 Depending on how the source file was formatted, some slides will not ideally reformat once the template is applied. Therefore, some reformatting will be necessary. Reapply slide layouts: Task Pane / Slide Layout Can be applied thru normal or slide sorter view May have to reapply the layouts more than once in order to take effect Limit altering slide layout attributes on your slide (fonts, positioning, text box anchoring, positioning, etc.), this will create less reformatting rework when switching templates in the future or repurposing this slide in other presentations. Use “shift returns” if text wraps are needed to wrap around imagery. If slide layout customization is needed, it ’s advised to break the customized text box from the slide layout by selecting the bounding box of the altered text box and cutting it from the slide, apply either the title slide layout or the blank layout, and then paste the text box back onto the slide. Your custom-formatting of the text layout will then be retained for future repurposing in other presentations. Recolor graphics if needed by using the embedded color palette swatches already in this template. Slide text: Don ’t create long sentences or paragraphs on slides. Use concise bulleted list format. Use speaker notes for supporting bulleted content to avoid slides that are too text heavy. Use sentence case capitalization for presentation titles, slide titles, category labels and bullets: Format / Change Case / Sentence Case. Initial capitalization is limited to our products and offerings. When referring to IBM products, use the correct full name, do not abbreviate. Imagery Avoid using cartoon like clip-art, use photo-art instead. Third party material cannot be used in a presentation without written permission (this includes product and Web page screen shots). Images must be acquired from a ‘ royalty-free to use ’ source such as: Microsoft or Lotus Symphony Clip Art library http://www.freebyte.com/clipart_images_photos_icons/#freevectorgraphics http://www.freedigitalphotos.net/ IBMers can use images from IBM approved image libraries: https://w3-03.ibm.com/software/marketing/marksite.nsf/AllMarketingPages/Brand-Rational-rt_rtb?OpenDocument&ExpandSection=4#_Section2 Close each presentation with the mandatory “Rational ThankYou Slide” located in the back of this file.
  • In the middle of a revolution Even if we say testing is the last thing we do … when we have time, it is the place whete the biggest investment are done Inside testing market, segment that are growing very fast
  • ALM paas grows at 23% CAGR
  • These is my humble experience of test practitioner and as manager. The trends I strongly believes in, and that will go mainstream Beta tester Booth T19
  • Optional slide. Graphic is available in English only.
  • Giveaway Slide
  • Mandatory closing slide (2 of 2) Thank You Slide (available in English only).
  • Optional slide. Graphic is available in English only.
  • Author Notes: This template has been built in PowerPoint 2003. If you ’re using PowerPoint 2007 or above, you may experience different usability results than what is provided as guidance here. Depending on how the source file was formatted, some slides will not ideally reformat once the template is applied. Therefore, some reformatting will be necessary. Reapply slide layouts: Task Pane / Slide Layout Can be applied thru normal or slide sorter view May have to reapply the layouts more than once in order to take effect Limit altering slide layout attributes on your slide (fonts, positioning, text box anchoring, positioning, etc.), this will create less reformatting rework when switching templates in the future or repurposing this slide in other presentations. Use “shift returns” if text wraps are needed to wrap around imagery. If slide layout customization is needed, it ’s advised to break the customized text box from the slide layout by selecting the bounding box of the altered text box and cutting it from the slide, apply either the title slide layout or the blank layout, and then paste the text box back onto the slide. Your custom-formatting of the text layout will then be retained for future repurposing in other presentations. Slide numbers may be duplicated in the footer of your slides. You ’ll have to delete the page numbers on the left manually for each slide. Recolor graphics if needed by using the embedded color palette swatches already in this template. The color palette is also specified on the slide above. Slide text: Don ’t create long sentences or paragraphs on slides. Use concise bulleted list format. Use speaker notes for supporting bulleted content to avoid slides that are too text heavy. Use sentence case capitalization for presentation titles, slide titles, category labels and bullets: Format / Change Case / Sentence Case. Initial capitalization is limited to our products and offerings. When referring to IBM products, use the correct full name, do not abbreviate. Imagery guidelines: Avoid using cartoon like clip-art, use photo-art instead. Third party material cannot be used in a presentation without written permission (this includes product and Web page screen shots, and photos). Images must be acquired from a ‘ royalty-free to use ’ source such as: Microsoft or Lotus Symphony Clip Art library http://www.freebyte.com/clipart_images_photos_icons/#freevectorgraphics http://www.freedigitalphotos.net/ IBMers can use royalty-free images from the following repositories : IBM Brand Systems Center / Assets / Photography Login instructions: https://w3-connections.ibm.com/forums/html/topic?id=c1082624-e54c-4e04-bad1-ddb150ac7540 IBM Software Story Images https://w3-connections.ibm.com/files/app#/collection/b7570645-b2f8-4450-a27f-9269a163fc2d IBM Rational Presentation Image Library: https://w3-connections.ibm.com/wikis/home?lang=en_US#!/wiki/Rational%20Presentation%20Templates,%20Guidelines,%20and%20Resources/page/Presentation%20Image%20Library
  • Transcript

    • 1. How Agile and Continuous Deploymentdisrupt traditional functional testing process!Learn about new testing techniquesLaurent PYCEO, SmartestingLaurent.py@smartesting.com@py_laurentSession 1279© 2013 IBM Corporation
    • 2. Agenda Introduction New testing challenges Language of the tester Demo Perspectives Q&A
    • 3. Time for disruption ?
    • 4. Testing: Time for disruption ?Software testing vendors:N°1: HP (QC, QTP, BPT)N°2: IBM (RQM, RTW)N°3: Micro Focus (SilkCentral,SilkTest)Where do we find the best practices?Do you think they use Quality Center?
    • 5. Smartesting engineering process (early years 2004-2006) Water fall process–Very few tests made by developers (No TDD)–1 release every 6 months–1 month (x5 engineers) spent on acceptance testing beforerolling out–Very poor QA impacting customers feedback
    • 6. Introducing agile development (2006) Introduction of agile: Scrum, TDD (unit &integration testing), pair programming…–Continuous integration–1 release every 3 months–4 man/days spent on acceptance testing beforerolling out–Very good Quality
    • 7. Going to the cloud (2012) Introduction of continuous deployment and DevOps–SEVERAL releases a DAY! Enable business agility–Acceptance Testing Driven Development (ATDD)–Engineering process driven by testing !http://www.thucydides.info/blog/295-does-atdd-really-save-you-timeWith ATDD and TDD projects delivered 31% faster with 4 times fewer defects
    • 8. Agenda Introduction New testing challenges Language of the tester Demo Perspectives Q&A
    • 9. 9Req Management &DefinitionTest Planning Execution Defect management Agility leads to short iterations, less planning, and massiveautomation (with rise of mobile, virtualization) Value chain is shrunk acceptance test is the requirement⇒(elicitation) Testing drives the engineering process !!!The testing value chain is being shaken
    • 10. 10The traditional approachRequirementManagementToolTestManagementtoolTechnicalSpecificationTraceabilityTraceabilityTraceabilityAmbiguous,Incomplete…Inadequate coverage,Hard maintenance…Lack of collaboration andshared understandingDisconnected withRequirements…
    • 11. 11DefineExecuteMeasureTest automationTest virtualizationMobile testingScanner (capture & replay)AnalyticsModel DrivenTestingExploratory testingATDDAccelerate the testing cycleLEAN ?
    • 12. 12Acceptance Testing Driven Development (ATDD) in aNutshell Begin with the end in mind Test is THE definition of done Written prior to development Confirmed with stakeholders May or May not be automatedSupport CritiqueCode Level Unit Testing Inspections, codequality analysisBusiness Level AcceptancetestingExploratorytestingTest in natural languageTest fixtureCode
    • 13. 13ATDD in a Nutshell Some Benefits–Collaboration and Communication–Team knows what successful implementation means–Achieving better coverage of business expectations–Shorten the feedback cycle (lean) And some Challenges:–Change in process so must have management support–Find the right Balance People/Process/Tool
    • 14. 14DefineExecuteMeasureLEAN!Get feed-back fasterStop planning it! Do it!Stop planning it! Do it!Increase velocity withMore test automationRequirements/Stories acceptance testsATDD: Accelerate the testing cycle
    • 15. 15DefineExecuteMeasureTest automationTest virtualizationMobile testingScanner (capture & replay)AnalyticsModel DrivenTestingExploratory testingATDDTestinglanguageTestinglanguageAccelerate the testing cycle
    • 16. Agenda Introduction New testing challenges Language of the tester Demo Perspectives Q&A
    • 17. 17Lessons learnedConcrete test Abstract testAdoptionProductivityTesters: find the right level ofabstraction for the best productivity
    • 18. 18Testing VS DevelopmentTests are a subset of the behavior of the application
    • 19. 20Lessons learned: The concepts Steps & scenarios are the key elementsGherkin languageScenario=list of free step
    • 20. 21Lessons learned: Abstraction Function/Keyword/Action Word… Data: physical VS logical Graphical flow (no semantic to strong semantic) Behavior: IF THEN ELSE, WHILE RulesEasyEasyMediumHardHard
    • 21. 22Lessons learned: Action Word Keyword/Action Word are easy to understand Powerful abstraction for maintenance But, It can be hard to get the right factorization Not every step needs to be reusableDefinition of Smart: Right balance between two levels
    • 22. 23 Should be parameterized (use logical data & data tables) Can include several other steps and Action Words Enable different levels of abstraction (Workflow, feature)Lessons learned: Action WordAW1 AW2AW3 AW4 AW5 AW5 AW6WorkflowFeature
    • 23. 24Lessons learned: Scenario, Action Word, Step, dataWith these simple concepts you can get:Flexibility to describe business domainPowerful refactoring capabilities
    • 24. 25
    • 25. 26Platform in the cloud for ATDDUse Case 1: You are agile and do continuous integrationATDD PlatformCreate acceptance testsTesterValidateacceptance criteriaBusiness Analystuseacceptance criteriaDeveloperCoderepositoryIntegrate with• Smartesting DSL• Smart refactoring capabilities• Collaboration• Smartesting DSL• Smart refactoring capabilities• Collaboration
    • 26. 27Platform in the cloud for ATDDUse Case 2: You are in a more traditional environment and got a testmanagement toolATDD Platform• Smartesting DSL• Smart refactoring capabilities• Collaboration• Smartesting DSL• Smart refactoring capabilities• CollaborationTestManagementTool QC/QTPRQM/RTWRequirementManagementToolRRC
    • 27. 28Platform in the cloud for ATDDSetup your project and be ready to start in60 Seconds
    • 28. Agenda Introduction New testing challenges Language of the tester Demo Perspectives Q&A
    • 29. 30ALM market dynamic New software delivery models Testing is the biggest ALM segment Distributed Testing segment represents more than $2b in2013 10% (http://www.gartner.com/id=2098416) Increasingly focused on Web & mobile Security testing is the fastest growing segment
    • 30. 31More Cloud ALM paas: $315m in 2016 (http://www.gartner.com/id=2188816) Started by defect management, load tests, dev or test lab provisioning Drivers–Agile development–Speed of deployment and business agility Inhibitors–Managing the transition–Lack of integration (OSLC)
    • 31. 32Test earlier & more automation Definition level–More ATDD–Testing driving the engineering process–More & smarter tools to support design and maintenance Test Execution–Test lab, virtualization–New generation of Automation Tools
    • 32. 33Laurent PYCEO, SmartestingLaurent.py@smartesting.com@py_laurent
    • 33. 34Daily Apple TV giveaway Complete your session surveys online each day at a conference kiosk or onyour Innovate 2013 Portal! Each day that you complete all of that day’s session surveys, your name willbe entered to win the daily Apple TV! On Wednesday be sure to complete your full conference evaluation to receiveyour free conference t-shirt!
    • 34. 35© Copyright IBM Corporation 2013. All rights reserved. The informationcontained in these materials is provided for informational purposes only, and isprovided AS IS without warranty of any kind, express or implied. IBM shall not beresponsible for any damages arising out of the use of, or otherwise related to,these materials. Nothing contained in these materials is intended to, nor shallhave the effect of, creating any warranties or representations from IBM or itssuppliers or licensors, or altering the terms and conditions of the applicable licenseagreement governing the use of IBM software. References in these materials toIBM products, programs, or services do not imply that they will be available in allcountries in which IBM operates. Product release dates and/or capabilitiesreferenced in these materials may change at any time at IBM’s sole discretionbased on market opportunities or other factors, and are not intended to be acommitment to future product or feature availability in any way. IBM, the IBM logo,Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM productsand services are trademarks of the International Business Machines Corporation,in the United States, other countries or both. Other company, product, or servicenames may be trademarks or service marks of others.

    ×