Your SlideShare is downloading. ×
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
No More No Repro
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

No More No Repro

1,668

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,668
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Let me drill down into the capabilities in each product. For a more extensive list of capabilities, please go to www.microsoft.com.vstudio.Microsoft Visual Studio 2010 Professional is the essential tool for basic development tasks to allow developers to implement their ideas easily. This includes core capabilities for Windows, Web, and Office development, along with new capabilities for Cloud and SharePoint development. There are also new tools for Silverlight and Multi-core development. With Visual Studio 2010 the IDE and editor were refreshed using Microsoft Windows Presentation Foundation.[CLICK]Microsoft Visual Studio 2010 Premium is a complete toolset for developers to deliver scalable, high quality applications. This includes support for offline database development, unit testing and change management, static code analysis, performance profiling and code coverage and code metrics. New capabilities including UI test automation (aka Coded UI Tests) and Test Impact Analysis are available in premium.[CLICK]Microsoft Visual Studio 2010 Ultimate is the comprehensive suite of application lifecycle management tools for teams to ensure quality results from design to deployment. This includes IntelliTrace – the new historical debugger which enables debugging events that ran previously on your machine, or another machine. Microsoft Test and Lab manager is included in Ultimate enabling complete Test Case Management and test execution. Additionally the new architecture and modeling tools are included in Ultimate, including support for authoring UML diagrams (Activity, Use Case, Sequence, Component and Class diagrams are supported).[CLICK]
  • There are some additional products in the Visual Studio 2010 family.Team Foundation Server 2010 is the center of gravity – the hub for a development team. Team Foundation Server has a version control repository, a test case management database, a work item tracking and change management system, support of build automation and a comprehensive reporting solution built on SQL Server Reporting Services. Some of the new capabilities of Team Foundation Server include support for gated check-in, branch visualization and drag-n-drop merge, and new Agile Planning tools.[CLICK]Team Lab Management 2010 enables teams to configure and manage virtual lab environment. Team Lab Management works with System Center Virtual Machine Manage enabling teams to create environment templates, provision ring-fenced environments, and checkpoint those environments. Those checkpoints can be attached to bugs filed using the Test and Lab Manager enabling the person fixing the bug to open the environment right to the appropriate point in the application flow.[CLICK]Visual Studio Test Elements 2010 is the essential tool for anyone engaging in test case management or manual test execution in the development lifecycle. This tool is designed for the generalist tester – someone who tests applications, but who is not responsible for writing code. This product includes Microsoft Test and Lab Manager (the Visual Studio IDE is not included). [CLICK]
  • The idea is you can take all of your learned best practices and begin to layer them into areas that need the most help. The notion of “best practices” apply at many levels when talking about the Application Lifecycle – from the individual to the organization.
  • The 2010 release for Microsoft is a very big release with a lot of rich capabilities. Quality is a key pillars for the release planning efforts and we aspired to achieve the above goals with the test offerings in the 2010 release by taking a fresh look at the problems.We want to align QA with the lifecycle to ensure that testers can add more value to the application lifecycle and are not looked at “necessary evil”. Having test assets co-located with the dev assets & project assets ensures visibility across the entire team.Create tighter integration across development & test teams to ensure that we can eliminate waste across the hand shake (or lack there of) that happens across devs & tests when it comes to bugs, builds, recreation of bugs etc. Enable highly leveraged QA teams ensures that teams are most efficient and are driving up productivity by focusing on key tasks and eliminating a lot of the waste that spans from boring repetitive tasks.
  • Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
  • Having the right infrastructure and approach to testing is helps ensure high quality deliverables at the end of the development cycle. Visual Studio 2010 Ultimate arms you with tools to ensure that testing is done right the first time and streamlines the testing process to ensure that you can deliver on time and on budget.Test and Lab ManagerVisual Studio 2010 Ultimate delivers a brand new product for manual testing and test case management. The new Test and Lab Manager interface is a thoroughly modern interface that allows testers and anyone else involved in testing to manage test plans, test cases and individual tests. In addition, Test and lab manager acts as the one stop shop for manual testing. When executing manual tests, the Test and Lab Manager interface morphs into the Microsoft Test Runner, a modern integrated manual test interface that allows manual tests to be executed and the results to be filed in a simple and productive way. Additionally, Microsoft Test Runner can take a snapshot of the system data, record a video of the test, take a picture of the bug and record the IntelliTrace log to ensure you can always repro a bug, and there are no more "not reproducible" discussions. Virtual Test EnvironmentsOne of the most costly aspects of testing is the maintenance of the test infrastructure. A traditional test infrastructure consisted of rooms full of physical test machines that required dedicated professionals to provision and maintain. With Visual Studio 2010 Ultimate this test infrastructure has gone virtual. By using the new virtualized test lab management capabilities it is possible to reduce the overhead inherent with maintaining a physical test infrastructure and instead take advantage of the power of virtualized environments. It is also possible to share these environments not only within your testing team but also with other members of the team who need access to specific environments for development tests or dry runs prior to full scale testing begins.Web and Load TestingVisual Studio 2010 Ultimate also gives you access to advanced web and load testing features that help you ensure that whatever application you are building it is ready for the most demanding uses. The Web and Load testing capabilities of Visual Studio 2010 Ultimate help you ensure that whatever application you are building it is ready for whatever scenarios your organization can envisage taking you one step closer to knowing your application is ready for prime time.
  • Having the right infrastructure and approach to testing is helps ensure high quality deliverables at the end of the development cycle. Visual Studio 2010 Ultimate arms you with tools to ensure that testing is done right the first time and streamlines the testing process to ensure that you can deliver on time and on budget.Test and Lab ManagerVisual Studio 2010 Ultimate delivers a brand new product for manual testing and test case management. The new Test and Lab Manager interface is a thoroughly modern interface that allows testers and anyone else involved in testing to manage test plans, test cases and individual tests. In addition, Test and lab manager acts as the one stop shop for manual testing. When executing manual tests, the Test and Lab Manager interface morphs into the Microsoft Test Runner, a modern integrated manual test interface that allows manual tests to be executed and the results to be filed in a simple and productive way. Additionally, Microsoft Test Runner can take a snapshot of the system data, record a video of the test, take a picture of the bug and record the IntelliTrace log to ensure you can always repro a bug, and there are no more "not reproducible" discussions. Virtual Test EnvironmentsOne of the most costly aspects of testing is the maintenance of the test infrastructure. A traditional test infrastructure consisted of rooms full of physical test machines that required dedicated professionals to provision and maintain. With Visual Studio 2010 Ultimate this test infrastructure has gone virtual. By using the new virtualized test lab management capabilities it is possible to reduce the overhead inherent with maintaining a physical test infrastructure and instead take advantage of the power of virtualized environments. It is also possible to share these environments not only within your testing team but also with other members of the team who need access to specific environments for development tests or dry runs prior to full scale testing begins.Web and Load TestingVisual Studio 2010 Ultimate also gives you access to advanced web and load testing features that help you ensure that whatever application you are building it is ready for the most demanding uses. The Web and Load testing capabilities of Visual Studio 2010 Ultimate help you ensure that whatever application you are building it is ready for whatever scenarios your organization can envisage taking you one step closer to knowing your application is ready for prime time.
  • Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
  • Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
  • The more time you spend debugging and fixing code the less time you have to spend creating innovative solutions and bringing value to the outcome. Visual Studio 2010 Ultimate includes features that help you reduce the number of bugs that get into an application thereby freeing you up to spend more of your time being creative around the solutions you deliver. Dependency DiagramsMaking changes to code can be fraught with danger and often leads to many types of new bugs being introduced into a solution that can be difficult to debug and fix. Visual Studio 2010 Ultimate allows you to create dependency diagrams that allow you to visually understand the dependencies between various areas of a solution helping you find where to make changes and what potential ripple effect those changes may have.Gated Check-InOne of the most costly problems that development teams face is when a build gets broken. This can potentially stop all development work for an entire team while the cause of the broken build is investigated and fixes are put in place. Visual Studio 2010 Ultimate includes an innovative new feature called Gated Check-In that looks to stop build breaks before they happen. By utilizing the shelving infrastructure first introduced into TFS in 2005, Gated Check-Ins allow developer to check code into source control but hold that check-in from the build tree until it has passed all the required validation and test required to ensure that there are not potential issues that may break the build. This is all done in the background and allows you to continue working while the checks and validations are performed.Code Analysis and Code MetricsOne easy way to reduce the number of bugs that occur is to simply ensure that the code you right is higher quality. Visual Studio 2010 Ultimate helps you find and fix problems before you make them by delivering advanced tools that analyze code for potential issues and ensure that code that is written is of high quality and maintainable.
  • Debugging code takes up a disproportionate amount of the development lifecycle. With the new features in Visual Studio 2010 Ultimate you can ensure that you reduce the amount of time spent debugging code to a minimum. IntelliTraceThe new IntelliTrace feature makes the “no-repro” discussion a thing of the past. It records the application’s execution history guaranteeing that the developer can always reproduce a reported bug. Step back in time to see the exact application state at the point of time when the bug occurs and use the inline call hierarchy to quickly trace a program’s execution flow without invoking the debugger. Automatically open the code at the place exactly where the code broke, reducing debugging time. Test Impact Analysis and Code CoverageTest impact analysis can tell you exactly what tests are impacted when you change a piece of code allowing you to choose to only run impacted tests. When you change a piece of code, Visual Studio 2010 Ultimate can make an automatic recommendation of tests based on that change leading to reduced testing time. Coupling this functionality with the Code Coverage tools ensure that not only are you running the appropriate tests but that you are testing all of your code so you can be confident that the code you deliver is free of defects.Coded UI TestsOnce you have found bugs in your code and have taken the steps to fix them, automated regression tests ensure that as you progress further through the development process that you catch any bugs that may have been re-introduced earlier in the cycle. This in turn ensures that you find new bugs earlier and can catch them when they are less costly to fix.
  • http://blogs.msdn.com/mathew_aniyan
  • http://blogs.msdn.com/gautamg/archive/2010/01/07/platform-support-for-coded-ui-test-and-fast-forward-feature-of-test-runner.aspx
  • Transcript

    • 1. No more “No Repro”
      Anna Russo
      Notion Solutions http://www.notionsolutions.com
      arusso@notionsolutions.com
      Blog: http://a7russo.spaces.live.com
    • 2. Visual Studio 2010
    • 3. Microsoft Test Manager
      TFS
      UML Modeling
      TFS
      Manual Testing
      Layer Diagram
      Load Testing
      Web Testing
      Test Case Management
      IntelliTrace™
      Architecture Explorer
      Logical Class Designer
      Cloud Development
      Office Development
      Windows Development
      New WPF Editor
      Customizable IDE
      Multi-core Development
      Silverlight Tools
      Web Development
      SharePoint Development
      Generate from Usage
      Static Code Analysis
      Database Deployment
      Code Metrics
      Database Unit Testing
      Test Data Generation
      Test Impact Analysis
      UI Test Automation
      Code Coverage
      Performance Profiling
      Database Change Mgmt
      TFS
      Test Record & Playback
    • 4. TFS
      Test and Lab Manager
      Test Case Management
      Test Record & Playback
      Manual Testing
      Lab MgmtConfig.
      Checkpoint Environment
      Environment from Template
      Virtual Env. Setup/Tear Down
      Reporting
      Team Portal
      Test Case Management
      Branch Visualization
      Version Control
      Build Automation
      Gated Check-in
      Agile Planning Tools
      Team Explorer
      Team Agents
      TFS
    • 5. Highly integratedProductive Extensible Low administration
      AgileCustomizable Lightweight Patterns and practices Flexible
      Layering Best Practices
      Process and tools support individuals, teams and organizations frictionlessly and transparently
      Overcome Complexity
      Quality Mindset
      Culture of Innovation
      Collaboration
      Transparency
      Integration
      Clarity
      Alignment
      Efficiency
    • 6. Goals for 2010 Release - Quality
      Align QA with the Lifecycle
      Create tighter Dev/Test interaction
      Enable highly leveraged QA teams
    • 7. Key Test Capabilities in VS2010
      • Innovative Test Case Management
      • 8. Easy provisioning of multi-tier test environments
      • 9. File rich & actionable bug during manual testing
      • 10. Perform Exploratory testing
      • 11. Create Coded UI Test
      • 12. Automated build-deploy-test workflow
      7
    • 13. Automated Build
    • 14. Powerful Build Engine
      Build Explorer
      Centralized build information
      Build Report to display code and work items
      Executes Tests
      Unit test
      Automated Coded UI test
      Web tests
      Load tests
      Third party tool tests
      Deploy
      Physical machines
      Virtual machines
      Virtual Lab machines- Restores to Clean Baseline
    • 15. Test Lab Management
    • 16. Lab Management
      NEW!
      * Support for ESX will not be available in TFS 2010 but is on the TFS roadmap
    • 17. Lab Management (1 Server, 1Host, 5 VMs)
      Physical Host
      SC-VMM Agent
      Client
      Virtual Guest
      Build/Test Agents
      Virtual Guest
      Build/Test Agents
      Controllers
      Virtual Guest
      Build/Test Agents
      Virtual Guest
      Build/Test Agents
      Virtual Guest
      Build/Test Agents
      Server
      Team Foundation Server
      SC-VMM Server
      (supports HyperV. VmWare)
      TR
      TCM
      Lab Management
      Reporting
      Build
      WIT
      Proxy
      VC
    • 18. Test Controllers and Agents
    • 19. Microsoft Confidential
      14
      Environment (collection of VMs) created
    • 20. Microsoft Confidential
      15
      Manage snapshots for environment
      Access environment using Lab Environment Viewer
    • 21. Manual Testing Tools
    • 22. Testing Done Right
      Test and Lab Manager
      Manual Testing for the 21st century
      Plan, Manage and Execute tests from one place
      Virtual Test Environments
      Reduce the overhead of maintaining physical test environments
      Share Virtual environments between team members
      Web and Load Testing
      Know your code is ready for the big time
      Measure performance under real time load conditions and ensure that your applications are ready for release
    • 23. Testing Tools
      MTM
      Manual Testing Tools
      Test Plan Management
      Test Case Management
      Shared Steps Management
      Test Configuration Management
      Test Fast Forwarding
      Test Collectors
      Test Lab Management
      Visual Studio
      Automated Testing Tools
      Automated Coded UI Testing
      Web Testing
      Load Testing
      Generic Tests
      Developer Unit Tests
      Database Unit Tests
    • 24. The Problem
      Development and test have built a wall:
      Development work happens on one side of the wall.
      Testing happens on the other.
      Builds and test results are passed back and forth, but not in a collaborative fashion.
    • 25. Development Perspective
      Works on my machine!
      What build is being tested?
      How do I repro this?
      I already fixed this bug!
      The testers are clueless twits that don’t even know what good software is!
    • 26. Test Perspective
      This is still broken? They said they fixed it!
      What is supposedly fixed in this new build?
      Is the new build deployed to our QA environment?
      The developers are clueless twits that don’t even know what good software is!
    • 27. Rich Bugs
      NEW!
      Repro Steps
      Screenshot
      Video Capture
      System Info
      Debug Log
      Test Environment
      Event Log
      Action Recording
    • 28. Demo
      Test Case Management/Filing Bugs
    • 29. Microsoft Confidential
      24
      Test Case is first class work item in TFS
      Detailed steps along with expected results
    • 30. Microsoft Confidential
      25
      Data drive a test case
      Specify data in parameter table
    • 31. Microsoft Confidential
      26
      Shared Steps allows for common steps to be reused across test cases
    • 32. Microsoft Confidential
      27
      Add comment
    • 33. Microsoft Confidential
      28
      Dev clicks on lvr link & selects connect to snapshot of the environment
    • 34. Developer Quality Tools
    • 35. Create code, Don’t debug it
      Dependency Diagrams
      Understand code dependencies visually and understand where to make changes
      Gated Check-In
      Stop build breaks before they happen
      Code Analysis and Code Metrics
      Help you find and fix potential problems before you make them
    • 36. Spend Less time Debugging
      IntelliTrace™
      Make “No-Repro” History with Actionable Bugs
      Test Impact Analysis and Code Coverage
      Run the Right Tests and only the Right Tests
      And know you have really tested you code
      Coded UI Tests
      Automated regression tests let you find bugs earlier
    • 37. IntelliTrace
    • 38. Test Impact Analysis
      Identify tests that need to be run as the result of a code change
    • 39. Coded UI Testing
      Enables verification of UI functionality.
      Record test actions and VS will generate the resulting code.
      Assertions can be added to verify functionality.
      Like all VS tests, results can be stored in TFS.
    • 40. Demo
      Intellitrace/Coded UI Test
    • 41. Coded UI Platform Support
    • 42. Reporting
    • 43. Improved Reporting
    • 44. Improved Reporting
    • 45. Are we making progress on running test plans?
      How are our builds doing over time?
      Are we fixing bugs?
      What’s the quality of our bug fixes?
      What’s the value?
    • 46. Summary
      Microsoft test offerings align QA with lifecycle
      Microsoft has a comprehensive offering for testers and developers that enables them to break the silos between dev & test
      Integrated offerings enable QA teams to be more leveraged
      Built for extensibility by partners
      41
    • 47. Contact Info
      Anna Russo
      arusso@notionsolutions.com
      Weekly Team System Webcasts
      http://www.notionsolutions.com
      Blog
      http://a7russo.spaces.live.com
      42

    ×