• Like
Scrum Gathering 2012 Shanghai_敏捷测试与质量管理分会场演讲话题:探索性测试之旅 – 我们团队的探索性测试实战经验(张克冰)
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Scrum Gathering 2012 Shanghai_敏捷测试与质量管理分会场演讲话题:探索性测试之旅 – 我们团队的探索性测试实战经验(张克冰)

  • 1,309 views
Published

讲师 :张克冰 …

讲师 :张克冰
2011年加入SAP 中国研究院,担任质量管理专员, 主要负责软件开发过程中的质量标准和测试策略的制定,公司级探索性测试培训师,教练。 十年软件从业经验,一致专注于软件测试和软件质量管理领域。2009年开始接触敏捷开发,热衷于敏捷, 热衷于提高软件测试在scrum中的工作有效性。

话题介绍:
敏捷开发模式下, 虽然自动化测试的作用日益强大,但是手工测试始终是软件测试不可缺少的一部分。 手工测试该如何去适应敏捷开发的步伐?是墨守成规的脚本化测试,还是漫无目的的随机测试?探索性测试给敏捷开发团队提供了一种轻快,有效的测试方法。 在实战中,我们把探索性测试跟scrum结合起来,让每个scrum的成员都有机会参与手工测试。 在测试的过程中,大家感受到探索性测试的乐趣, 更重要的是,我们在摸索探索性测试的过程中,通过不断的尝试,探索出适合我们团队的探索性测试的模式。 作为公司的探索性测试培训师和教练,我跟大家经历了从认识它,学习它, 到不断改进它, 直到这个方法可以适应复杂大型的ERP软件开发的过程。对于我来说, 探索性测试不但是一种新的测试方法,更加可以促进scrum对已有的测试和质量管理流程进行改进。 非常希望有机会跟大家分享我们在探索性测试的道路上收获的经验和反思。
Agenda: 1. 敏捷模式下的手工测试。2. 探索性测试简介。3.探索性测试之旅。4. 实战中的探索性测试。 5.探索性测试的反思和未来之路

Published in Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,309
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
68
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Our Exploratory Testing JourneyZhang KebingSAP Labs China PublicJune, 2012© 2011 SAP AG. All rights reserved. Public 1
  • 2. Disclaimer:This presentation outlines our general product direction and should not be relied onin making a purchase decision. This presentation is not subject to your licenseagreement or any other agreement with SAP. SAP has no obligation to pursue anycourse of business outlined in this presentation or to develop or release anyfunctionality mentioned in this presentation. This presentation and SAPs strategyand possible future developments are subject to change and may be changed bySAP at any time for any reason without notice. This document is provided without awarranty of any kind, either express or implied, including but not limited to, theimplied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in thisdocument, except if such damages were caused by SAP intentionally or grosslynegligent.© 2011 SAP AG. All rights reserved. Public 2
  • 3. The role of manual testing in Scrum Shipping new features after each sprintWe use manual test when1. Some features are too costly to automate.2. Some features are not automatable.3. Find the complicated bugs.4. Explore new ways of testing a feature.© 2011 SAP AG. All rights reserved. Public 3
  • 4. Ad hoc vs. Scripted Test Case Design Ad hoc Scripted Testing Design effort Testing Low High• No test strategy • High planning/maintenance• No focus effort• No traceability • No variations • Kills creativity © 2011 SAP AG. All rights reserved. Public 4
  • 5. Exploratory Software Testing with Tours A lightweight approach to test case design and execution[1] © 2011 SAP AG. All rights reserved. Public 5
  • 6. Exploratory TestingInteraction Creativity [2] [3]© 2011 SAP AG. All rights reserved. Public 6
  • 7. Analogy: A software tester is like a tourist… • You can not see everything • There are lots of different ways of exploration • You want to make sure to see the most important things [4]© 2011 SAP AG. All rights reserved. Public 7
  • 8. Feature: Campaign Management in Real Estate© 2011 SAP AG. All rights reserved. Public 8
  • 9. Garbage Collector TourGarbage men go street by street, house by house. They stay onlya few moments but they crisscross the neighborhood in amethodical manner.© 2011 SAP AG. All rights reserved. Public 9 [5]
  • 10. Garbage Collector Tour 1  Example for Campaign in Real Estate 1. Open the UI of add a new Campaign. 2. Execute all main sub-frames. 3. Make sure you go to each sub-frame and create a new item. 4. Don’t test every detail. 5. Test document© 2011 SAP AG. All rights reserved. Public 10
  • 11. Garbage Collector Tour 2 Example for Campaign in Real Estate1. Open the UI of add a new Campaign.2. Only test one campaign type, but check all the buttons on the menu.3. Don’t touch other sub features.4. Test Document© 2011 SAP AG. All rights reserved. Public 11
  • 12. Anti-Social TourYou are not like everybody else. [6]
  • 13. Anti-Social Tour  Example If valid input is a number enter a character if valid input is a picture file use a word file if you are on the last page of a wizard hit “Back” and change something, … [7]© 2011 SAP AG. All rights reserved. Public 13
  • 14. Supermodel TourIt’s all about the look… © 2011 SAP AG. All rights reserved. Public 14 [8]
  • 15. Supermodel Tour Design and execution of the tour in general: 1. Pick a feature 2. Make sure it follows the UI guidelines 3. All icons are correct 4. All texts contain no spelling mistakes 5. …© 2011 SAP AG. All rights reserved. Public 15
  • 16. Standard ToursBusiness District Tourist District Seedy District• Guidebook Tour (F1 • Collectors Tour • Saboteur Tour) • Lonely Businessman • Antisocial Tour• Money Tour Tour • Opposite• Landmark Tour • Supermodel Tour • Crime Spree• Intellectual Tour • TOGOF Tour • Wrong Turn• FedEx Tour (TestOneGetOneFree) • Obsessive-Compulsive• After-Hours-Tour • Scottish Pub Tour• Garbage Collectors Tour1Historical District Entertainment District Hotel District• Bad-Neighborhood • Supporting Actor Tour • Rained-Out Tour• Museum Tour • Back Alley Tour • Couch Potato Tour• Prior Version Tour • All-Nighter Tour James Whittaker Exploratory Software Testing: Tips, Tricks, Tours, and Techniques to Guide Test Design Addison Wesley Pub Co Inc, 2009© 2011 SAP AG. All rights reserved. Public 16
  • 17. Exploratory Testing with Tours! Failure! Failure! Failure! Failure! [14]© 2011 SAP AG. All rights reserved. Public 17
  • 18. Exploratory Software Testing Ingredients Time Box Protocol Test Tour© 2011 SAP AG. All rights reserved. Public 18
  • 19. Time Box  Helps you to stay focused  It should between 30 – 60 minutes per tour  You must take note, record your test within time box  Prepare the test before you start to test© 2011 SAP AG. All rights reserved. Public 19
  • 20. Protocol – Test Document  Written on the fly by the tester  Documents what has been tested  Documents which bugs have been found  Documents which test opportunities are still available  Documents open questions (bug or feature?)  Examples© 2011 SAP AG. All rights reserved. Public 20
  • 21. Test Tour • Defines test approach (How) • Leaves the tester enough freedom to explore • Ensures tester stays focused, not testing everything [9]© 2011 SAP AG. All rights reserved. Public 21
  • 22. Integration into the Scrum process- Test StrategyTeam A: Unit Test Auto-System Test ET Team B: Scripted Test ET© 2011 SAP AG. All rights reserved. Public 22
  • 23. Integration into the Scrum process- Which tour? Reports • Intellectual Tours : ask the hardest questions to the reports. • Monthly close? • Enter transactions with huge amount? • View reports with multiple currencies? • …© 2011 SAP AG. All rights reserved. Public 23
  • 24. Integration into the Scrum process- Which tour? Invest more than one tours for a feature. • Garbage collector tour - Test Coverage • Anti-social tour - invalid inputs or operations. • Landmark tour - Features in different sequences.© 2011 SAP AG. All rights reserved. Public 24
  • 25. Integration into the Scrum process Story Tasks To-Do In Process Completed Done Story Story Bug1. Define Tasks – Planning Meeting2. Test Prepare - Tester3. Who perform – any team member4. Rules – Cross test, start test when all development tasks is done. © 2011 SAP AG. All rights reserved. Public 25
  • 26. What ET bring to our scrum team?Long document Just Enough VS [10]© 2011 SAP AG. All rights reserved. Public 26
  • 27. What ET bring to our scrum team?• Enlarge testing resource• Involve everyone [11] © 2011 SAP AG. All rights reserved. Public 27
  • 28. What ET bring to our scrum team?• Better test coverage• Each of tester has their own way to explore the software [12] © 2011 SAP AG. All rights reserved. Public 28
  • 29. Current Challenges • Try more tours with scrum team • Try more different approaches • Follow up on bug reports and find out whether your test strategy works or not.© 2011 SAP AG. All rights reserved. Public 29
  • 30. Try!Contact information:Zhang KebingQuality Engineer/ Scrum MasterKebingZhang@hotmail.com© 2011 SAP AG. All rights reserved. Public 30
  • 31. References[1] http://www.flickr.com/photos/statelibraryofnsw/2876551803/[2] http://www.quardev.com/articles/exploratory_testing[3] http://www.flickr.com/photos/bobcatrock/2862617356/[4] http://www.flickr.com/photos/gamene/4341746457/[5] http://www.flickr.com/photos/nasacommons/4858566574/[6] http://www.flickr.com/photos/foxypar4/1852428153/[7] http://www.flickr.com/photos/judepics/1950452493/[8] http://www.flickr.com/photos/istolethetv/4045140609/[9] http://www.nipic.com/show/1/66/71cbc36ac3b50aa9.html[10] http://www.superstock.com/stock-photos-images/1775R-6937[11] http://www.allmoviephoto.com/photo/2003_poster_smith_international.html[12] http://www.fs3000.com.cn/bbs/read.php?tid=610[14] http://blog.sysomos.com/2010/05/19/twittera-as-a-resource-tool/question-mark/© 2011 SAP AG. All rights reserved. Public 31
  • 32. © 2011 SAP AG. All rights reserved.No part of this publication may be reproduced or transmitted in any form or for any SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjectspurpose without the express permission of SAP AG. The information contained Explorer, StreamWork, and other SAP products and services mentioned herein asherein may be changed without prior notice. well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.Some software products marketed by SAP AG and its distributors containproprietary software components of other software vendors. Business Objects and the Business Objects logo, BusinessObjects, CrystalMicrosoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other BusinessMicrosoft Corporation. Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd.IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, Business Objects is anSystem x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, SAP company.zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and otherPOWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, Sybase products and services mentioned herein as well as their respective logosBladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAPRedbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, company.Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM All other product and service names mentioned are the trademarks of theirCorporation. respective companies. Data contained in this document serves informationalLinux is the registered trademark of Linus Torvalds in the U.S. and other purposes only. National product specifications may vary.countries. The information in this document is proprietary to SAP. No part of this documentAdobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or may be reproduced, copied, or transmitted in any form or for any purpose withoutregistered trademarks of Adobe Systems Incorporated in the United States and/or the express prior written permission of SAP AG.other countries.Oracle and Java are registered trademarks of Oracle and/or its affiliates.UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, andMultiWin are trademarks or registered trademarks of Citrix Systems, Inc.HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C ®,World Wide Web Consortium, Massachusetts Institute of Technology. © 2011 SAP AG. All rights reserved. Public 32