No more “No Repro” Anna Russo Notion Solutions http://www.notionsolutions.com firstname.lastname@example.org Blog: http://a7russo.spaces.live.com
Visual Studio 2010
Microsoft Test Manager TFS UML Modeling TFS Manual Testing Layer Diagram Load Testing Web Testing Test Case Management IntelliTrace™ Architecture Explorer Logical Class Designer Cloud Development Office Development Windows Development New WPF Editor Customizable IDE Multi-core Development Silverlight Tools Web Development SharePoint Development Generate from Usage Static Code Analysis Database Deployment Code Metrics Database Unit Testing Test Data Generation Test Impact Analysis UI Test Automation Code Coverage Performance Profiling Database Change Mgmt TFS Test Record & Playback
TFS Test and Lab Manager Test Case Management Test Record & Playback Manual Testing Lab MgmtConfig. Checkpoint Environment Environment from Template Virtual Env. Setup/Tear Down Reporting Team Portal Test Case Management Branch Visualization Version Control Build Automation Gated Check-in Agile Planning Tools Team Explorer Team Agents TFS
Highly integratedProductive Extensible Low administration AgileCustomizable Lightweight Patterns and practices Flexible Layering Best Practices Process and tools support individuals, teams and organizations frictionlessly and transparently Overcome Complexity Quality Mindset Culture of Innovation Collaboration Transparency Integration Clarity Alignment Efficiency
Goals for 2010 Release - Quality Align QA with the Lifecycle Create tighter Dev/Test interaction Enable highly leveraged QA teams
Key Test Capabilities in VS2010
Innovative Test Case Management
Easy provisioning of multi-tier test environments
File rich & actionable bug during manual testing
Perform Exploratory testing
Create Coded UI Test
Automated build-deploy-test workflow
Powerful Build Engine Build Explorer Centralized build information Build Report to display code and work items Executes Tests Unit test Automated Coded UI test Web tests Load tests Third party tool tests Deploy Physical machines Virtual machines Virtual Lab machines- Restores to Clean Baseline
Test Lab Management
Lab Management NEW! * Support for ESX will not be available in TFS 2010 but is on the TFS roadmap
Microsoft Confidential 14 Environment (collection of VMs) created
Microsoft Confidential 15 Manage snapshots for environment Access environment using Lab Environment Viewer
Manual Testing Tools
Testing Done Right Test and Lab Manager Manual Testing for the 21st century Plan, Manage and Execute tests from one place Virtual Test Environments Reduce the overhead of maintaining physical test environments Share Virtual environments between team members Web and Load Testing Know your code is ready for the big time Measure performance under real time load conditions and ensure that your applications are ready for release
Testing Tools MTM Manual Testing Tools Test Plan Management Test Case Management Shared Steps Management Test Configuration Management Test Fast Forwarding Test Collectors Test Lab Management Visual Studio Automated Testing Tools Automated Coded UI Testing Web Testing Load Testing Generic Tests Developer Unit Tests Database Unit Tests
The Problem Development and test have built a wall: Development work happens on one side of the wall. Testing happens on the other. Builds and test results are passed back and forth, but not in a collaborative fashion.
Development Perspective Works on my machine! What build is being tested? How do I repro this? I already fixed this bug! The testers are clueless twits that don’t even know what good software is!
Test Perspective This is still broken? They said they fixed it! What is supposedly fixed in this new build? Is the new build deployed to our QA environment? The developers are clueless twits that don’t even know what good software is!
Rich Bugs NEW! Repro Steps Screenshot Video Capture System Info Debug Log Test Environment Event Log Action Recording
Demo Test Case Management/Filing Bugs
Microsoft Confidential 24 Test Case is first class work item in TFS Detailed steps along with expected results
Microsoft Confidential 25 Data drive a test case Specify data in parameter table
Microsoft Confidential 26 Shared Steps allows for common steps to be reused across test cases
Microsoft Confidential 27 Add comment
Microsoft Confidential 28 Dev clicks on lvr link & selects connect to snapshot of the environment
Developer Quality Tools
Create code, Don’t debug it Dependency Diagrams Understand code dependencies visually and understand where to make changes Gated Check-In Stop build breaks before they happen Code Analysis and Code Metrics Help you find and fix potential problems before you make them
Spend Less time Debugging IntelliTrace™ Make “No-Repro” History with Actionable Bugs Test Impact Analysis and Code Coverage Run the Right Tests and only the Right Tests And know you have really tested you code Coded UI Tests Automated regression tests let you find bugs earlier
Test Impact Analysis Identify tests that need to be run as the result of a code change
Coded UI Testing Enables verification of UI functionality. Record test actions and VS will generate the resulting code. Assertions can be added to verify functionality. Like all VS tests, results can be stored in TFS.
Demo Intellitrace/Coded UI Test
Coded UI Platform Support
Are we making progress on running test plans? How are our builds doing over time? Are we fixing bugs? What’s the quality of our bug fixes? What’s the value?
Summary Microsoft test offerings align QA with lifecycle Microsoft has a comprehensive offering for testers and developers that enables them to break the silos between dev & test Integrated offerings enable QA teams to be more leveraged Built for extensibility by partners 41
Contact Info Anna Russo email@example.com Weekly Team System Webcasts http://www.notionsolutions.com Blog http://a7russo.spaces.live.com 42