Amq Overview Continuous Quality Assurance


Published on

This is the slide of MicroFocus\' products related to Quality Assurance.

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • TeamInspector works transparently with your existing version control systems to continuously analyze changes. This process issupported by key functions designed to proactively address the most common blunders shared by software development teams.For example, it supports:Server-based build and test automationTeamInspector automates the execution of build scripts, including any unit tests or other tasks that you have defined, whenever you check changes into the version control system (or at scheduled intervals). This functionality helps you deliver products on time and with higher quality, yet at a lower overall cost.Automated continuous upstream testing and manager-level reportingTeamInspector streamlines your development processes by providing automated continuous testing, both unit and functional. Additionally, TeamInspector provides managers with a “snapshot view” of critical test metrics early in the delivery process, allowing you to see trends and take action to ensure delivery of a quality product.Release readiness inspections and trending indicatorsUsing automated and open inspectors, the application can verify release readiness based on quantifiable data points across all facets of release – from code quality to unit test coverage. As a result, you can instantly see if something looks “off” (such as code coverage and complexity) and take proactive steps to head off problems early (when they are less costly to address), and reduce business exposure to faulty software. You can also perform cross-project analysis to gain insight into release readiness risks in build rates, standards compliance, and more.PublishingTeamInspector provides a convenient web interface to access current and previous distributions, along with theirassociated artifacts and reports. You can even rebuild your entire project at any past revision with the push of a button.RebuildingTeamInspector supports artifact management, enabling you to rebuild any version of the software at any time. So if you have a customer dealing with a defect in an older software version, you can rebuild their version, analyze the code, develop a solution, and provide it to the customer.Third-party inspectors and Software Change and Configuration Management supportMicro Focus integrates with multiple source control systems and has inspectors for many of the popular tools on the market.The product is an example of Micro Focus Open ALM promise: rather than locking you into expensive, inflexible single vendor solutions, Borland integrates your existing processes, technologies, and platforms across the software delivery lifecycle — empowering you to deliver software on your terms.And because TeamInspector does all of its work on the server, it’s entirely non-intrusive to the development environment – your developers can continue to use their existing version control clients and favorite IDEs.
  • With Micro Focus powerful requirements definition and management your business users, developers and quality assurance people can all visualize and how a system looks and behaves before a system before it is built. Getting everyone on the same page, visualizing and simulating a system prevents a high percentage of defects from ever getting documented or built into systems making this one of the effective ways to eliminate rework.
  • A centralized “single source of truth” for qualityFlexible, customer-friendly license modelOptimized specifically for the testing of both Agile AND Traditional projectsAdvanced test automation integration - Bottom Up Optimization – Automatic test registration, results and synchronization Supports Agile adoption without retro-fitting toolsTop Down Optimization - Jump-starts a superior quality processes by synchronizing with requirements to align testing with business needs. Out of the box test automation integrations and plug abilityALM technology integrations - Defect, Requirements, Project ManagementVirtual lab manager integration to increases efficiency reduce costs (VMware Lab Manager)multi-configuration and cross-platform testing utilizing virtualized environmentsDelivers management insight into the quality process with advanced reports:cross project statusrequirements and test coverage, quality trends & milestones, test type and defect trendsAgile reports
  • Amq Overview Continuous Quality Assurance

    1. 1. Partner Pre-sales training<br />December 2010<br />Continuous Quality AssuranceAMQ Product Overview<br />
    2. 2. Application Software Quality Domain Areas<br />Project Execution<br />Services<br />PPM<br />Requirement Management<br />Test Management<br />Modeling<br />Functional &<br />Regression Testing<br />Performance &<br />Load Testing<br />Development<br />Testing<br />Requirement Definition<br />Continuous Integration<br />Software Change & Configuration Management<br />Project Execution<br />Services & Training<br />
    3. 3. SilkPerformer<br />Automatic Generation of Test Cases<br />Load Test Capture<br />Load Test Automation<br />3rd Party Tools<br />Extensive Integrations<br />Public APIs & W/Services<br />Bi-directional Synchronization<br />CaliberRM<br />TeamInspector<br />SilkTest<br />DevPartner<br />Trace to<br />Models<br />Glossaries<br />Continuous Test <br />Automated Func. Test <br />Static Code Analysis<br />Baselines<br />Development Metrics<br />Regression Testing<br />Runtime Code Analysis<br />Impact Analysis<br />Traceability<br />Tracing Requirements to Test Cases<br />Development Metrics<br />ChangeManagement<br />StarTeam<br />Asset & Activity Mgt<br />Release Quality<br />Tracing Activities to Assets<br />ALM Products / IDE’s<br />Traceability & Versioning<br />Asset Versioning<br />Asset Versioning<br />Micro Focus Solutions<br />Requirements<br />CaliberRDM<br />Requirement Scenarios<br />Requirement Simulations<br />Silk Central <br />Test Manager<br />Storyboarding<br />Test Case Generation<br />Shared Library<br />Integration<br />Test Case Generation<br />Test Requirements<br />Together<br />Glossaries<br />Test Planning<br />Test Execution<br />BPM & UML Models<br />Issue Management<br />Round-trip Engineering<br />Reporting<br />Model Quality Assurance<br />Requirements<br />
    4. 4. Software Change & Configuration Management<br />
    5. 5. A Version Control System<br />Centralised repository<br />Basic VCS operations<br />Containers, fine-grained security<br />An SCM System<br />File/non-file artifact types<br />Visual branching/merging <br />Change tracking, process rules ..<br />ST supports enterprise ALM<br />Collaboration (topics, push notifications, tasks, requirements)<br />Customisation (workflow, forms), SDKs, wizards<br />Geographically distributed development<br />Traceability<br />What is StarTeam ?<br />
    6. 6. StarTeam provides…<br />Unified repository for all enterprise assets<br />Integrates all key lifecycle assets in one repository<br />Supports full lifecycle traceability and impact analysis<br />Highly optimized client-server interaction<br />Enables scalable, highly efficient communication<br />Supports true multi-cast and event-based transactions<br />Customizable workflow and forms<br />Requires little, if any, programming skill<br />Managed at the server so no client deployment issues<br />Workflow objects are versioned with all other assets<br />Enables workflow and forms definition for all asset types<br />What Makes StarTeam Unique ?<br />
    7. 7. Provides a single source of key information for distributed teams<br />Streamlines collaboration through a unified view of code and change requests<br />Industry leading scalability combined with low total cost of ownership<br />Example: EDS savings of $1.3M / year on server and administration costs by consolidating thousands of global users onto Star Team.<br />Benefits of Star Team<br />
    8. 8. StarTeam<br />The resolution may involve modifying or creating new code, test cases or documentation – all of which are versioned <br />The appropriate stakeholders interact with the issue through a customizable workflow – until resolution<br />Issues raised are placed in the central SCCM solution along with other drivers for change such as requirements and tasks.<br />
    9. 9. StarTeam<br />The properties of each step in the workflow include notification, limiting the duration in a step and escalation.<br />The workflow/s that govern the process are modified graphically and are version controlled in StarTeam too.<br />
    10. 10. StarTeam<br />“Promoting” a child view to a parent view may result in merge conditions. Files to merge are indicated…<br />…and a graphical merge tool allows users to determine the contents of the resulting merged file.<br />
    11. 11. StarTeam<br />Change Packages can then be applied to other branches of code by a simple drag and drop operation.<br />“Change Packages” contain all the elements changed as a single commit.<br />
    12. 12. StarTeam<br />Interact with the StarTeam server in a variety of clients – Eclipse in this instance.<br />Get access to all of the same items available in other clients – files, change requests, requirements, tasks, etc.<br />And for each item, get access to all of the same meta-data – such as labels, links and history.<br />
    13. 13. StarTeam<br />For users requiring a zero-install client, a web client is available. <br />Get access to all of the same items available in other clients – files, change requests, requirements, tasks, etc.<br />And see recently viewed items and favorites for quick retrieval <br />
    14. 14. Continuous integrationTeam Inspector<br />
    15. 15. Team Inspector<br />Team Inspector works transparently with your existing version control systems to continuously analyze changes. <br />This process supported by key functions designed to proactively address the most common blunders shared by software development teams.<br />For example, it supports:<br />Server-based build and test automation<br />Automated continuous upstream testing and manager-level reporting<br />Release readiness inspections and trending indicators<br />Publishing<br />Rebuilding<br />Third-party inspectors and Software Change and Configuration Management support<br />
    16. 16. ModellingTogether<br />
    17. 17. Together<br />Domain-Specific Language (DSL) Toolkit<br />Visual modelling for domain-specific meta models<br />Wizard-supported creation of DSL solutions, incl. diagram editors model transformations, code generators, and BIRT reports as Eclipse features<br />GMF-based UML 2.1 diagrams<br />Business Process Modelling<br />Business Process Modelling Notation(BPMN)+validation checking<br />Import/export of BPEL for Web Services (BPEL4WS)<br />UML Modelling / Data Modelling<br />Advanced Modelling and MDA<br />Documentation Generation<br />Quality Assurance<br />Code audits and metrics / OCL-based model audits & metrics<br />Team<br />Share diagrams and models between projects with version control StarTeam® integration<br />Generate use case diagrams from requirements, and trace model elements to/from requirements using Borland CaliberRM™and RequisitePro®<br />
    18. 18. LiveSource™Java, .NET, C++<br />Simplicity<br />UML<br />Docs<br />Patterns<br />SQA<br />Class Diagrams<br />Metrics<br />
    19. 19. Requirements Definition & Management<br />
    20. 20. “Traditional” approach to RDM<br /><ul><li>The general practice of requirements handling has inherent problems:
    21. 21. Document centric repository
    22. 22. Repetition
    23. 23. Inconsistency
    24. 24. Manual Linking / Tracing
    25. 25. Translation & interpretation
    26. 26. Not testable
    27. 27. Poor Reporting
    28. 28. Lack of visibility
    29. 29. Lack of Governance</li></li></ul><li>CaliberRDM<br />Easy to use<br />Fast and easy experiential simulation<br />Online Feedback & Review<br />Quick process diagramming (Scenarios) <br />Holistic RDM integration w/CaliberRM<br />Decision Support, Measures & Dashboard<br />
    30. 30. Visual clarity - simulation<br />
    31. 31. Caliber & SCTM: Jump-start testing from requirements<br />Synchronise<br />
    32. 32. Ease of use: Drag-and-drop assembly lets non-technical users create simulations in minutes<br />A realistic experience: Simulations use sample data and business logic from your organization, so stakeholders experience exactly how the software will perform in real life<br />Streamlined collaboration: Accessing simulations via the Web is an easy way for users to review and leave comments, shortening the feedback cycle and ensuring critical feedback is communicated clearly<br />Powerful analysis facilities: Business process storyboarding using multi-user, server-based process diagramming helps you define business processes and lets you quickly sketch and distribute diagrams, as well as attach images and other documents for additional context.<br />1,2 James Martin <br />Benefits of CaliberRDM<br />
    33. 33. CaliberRM<br />Easy to use<br />Automatic Change Notification and Tracking<br />Integrated Impact Analysis<br />Configurable Baselining<br />Collaborative Team Discussion<br />Life-cycle Traceability<br />Automated Document Generation<br />Distributed Web-Centric Architecture<br />CaliberRM Datamart: <br />Decision Support, Measures & Dashboard<br />Recognized industry leader in RM space<br />
    34. 34. CaliberRM<br />Manage all types of requirements as a set of discrete re-useable items<br />Manage the meta-data for each requirement including; status, owner and version<br />
    35. 35. CaliberRM<br />Manage the automatic notification resulting from a requirement change<br />
    36. 36. CaliberRM<br />Including the full details of any change – great for highly regulated industries<br />Manage the complete revision history for each and every requirement<br />
    37. 37. CaliberRM<br />Manage the relationship between each requirement and the items upstream and downstream of it including other requirements, code and tests <br />And perform impact (and gap) analysis <br />
    38. 38. CaliberRM<br />Baseline a set of requirements and apply electronic signatures<br />And produce requirement specification documents<br />
    39. 39. Secure information storage: CaliberRM provides a central, secure repository for all project requirements<br />End-to-end requirements traceability: The open architecture of CaliberRM lets you link user requirements to each step of the development lifecycle<br />End-to-end impact analysis: Multiple methods for visualizing traceability help you understand immediately the impact of a specific change<br />Diverse client set: CaliberRM includes clients for a variety of user interfaces, such as Web browsers, Eclipse, Microsoft® Visual Studio® and Windows®<br />Easy integration: Integration with other MicroFocus products enables you to weave software requirements management throughout the product development lifecycle<br />Benefits of CaliberRM<br />
    40. 40. Test ManagementSilk Central Test Manager(SCTM)<br />
    41. 41. Quality Management Challenges<br />Aligning with business needs and demonstrating value<br />Managing quality objectives across diverse quality methods<br />Managing the life cycle with one integrated process<br />Conquering the Agile frontier<br />Unifying the development and QA factions<br />
    42. 42. Test Management<br />Business<br /> Needs<br />Formalized <br />Requirements<br />Test Planning<br />Regression testing<br />New functionality<br />Running manual tests and recording results<br />Managing automated test execution and collecting results<br />Recording defects<br />Management visibility into software quality<br />Create & Manage Test Requirements<br />Build Tests & Test Plans<br />Manage Issues & Defects<br />Reporting for Decision Making<br />Organize & Facilitate Test Execution<br />Change & Version Control<br />
    43. 43. SilkCentral Test Manager Provides…<br /><ul><li>Totally web based test management system
    44. 44. Flexible powerful quality reporting system
    45. 45. Offline remote manual testing
    46. 46. Dynamic hardware provisioning (via VMWare lab manager) to increase testing throughput
    47. 47. Flexible, customer-friendly license model</li></li></ul><li><ul><li>CaliberRDM
    48. 48. CaliberRM
    49. 49. DOORS
    50. 50. RequisitePro
    51. 51. Word
    52. 52. Built-in
    53. 53. StarTeam
    54. 54. Bugzilla
    55. 55. Atlassian JIRA
    56. 56. IBM ClearQuest
    57. 57. Microsoft VSTS</li></ul>Open and Integrated<br /><ul><li>Micro Focus StarTeam
    58. 58. Subversion
    59. 59. Source Safe
    60. 60. PVCS, CVS, VFS
    61. 61. Microsoft VSTS
    62. 62. SilkTest 2010
    63. 63. TestPartner
    64. 64. Junit / Nunit / Fitnesse
    65. 65. SilkPerformer
    66. 66. Manual Testing
    67. 67. VMWare Lab Manager 4</li></ul>SilkCentral Test Manager <br />New!<br />New!<br />New!<br />New!<br />New!<br />
    68. 68. SilkCentral Test Manager<br />Manage test plans comprising unit, manual, automated and load tests<br />And manage the test details – manual test steps in this instance<br />
    69. 69. SilkCentral Test Manager<br />And any issues logged as a result of failed runs<br />For each test record the results of all historic runs<br />
    70. 70. SCTM Overview – Test Libraries<br />Reduced waste with re-use through test library<br />How does it work?<br />Shared test steps are stored in test library accessible from multiple test definitions <br />Shared across various projects and baselines<br />Advantages<br />Updates to test steps are replicated automatically (low maintenance)<br />Test steps can be bundled together and called from test definitions <br />(Example: Login steps)<br />Easily add or remove links to test library<br />Steps can be detached so they are no longer linked to the library<br />Steps can be added to the library from an existing test definition<br />Scope (Visibility) of the shared assets is configurable<br />Projects are assigned to a Library (or multiple libraries)<br />User Access to Projects determines Library access<br />
    71. 71. Library Sample<br />Shared Library<br />Shared Steps within Test Definition<br />
    72. 72. SCTM Overview – Versioning<br />Improved management of test assets with versioning<br />How does it work?<br />Version control for test definitions implemented through manual versioning within history tab<br />Versioning not available for Requirements<br />Version Management available for library and test plan tests<br />Advantages<br />Ability to ‘revert’ to prior version of test definition<br />Ability to compare 2 versions of test definition<br />Version Comparisons highlight delete/changed/new details within script – very clear to understand<br />
    73. 73. Version Comparison & Differences<br />Version Creation<br />Compare Versions<br />Revert Version<br />Compare Report<br />
    74. 74. SCTM Overview – Project Baselines<br />Improved management of test assets with project baselining<br />How does it work?<br />Provides a ‘snapshot‘ of a project at a given time<br />Baseline is performed against a ‘whole’ project not individual assets within<br />Multiple Baselines can exist for each project<br />Option to maintain links to shared library assets or make copy (resolve links) when creating baseline<br />Advantages<br />Visibility of Project Baselines against parent projects<br />Baselines are shown as child of parent project – clear association<br />History of assets will show when baseline was created and from which project and label as such<br />Easily generate reports against current project status compared to the baseline, for example difference in test definitions<br />
    75. 75. SCTM Overview – Requirements Integration<br />Next generation requirements and risk driven testing<br />How does it work?<br />View and manage CaliberRDM 2010 requirements in requirements unit of SCTM<br />Requirements and attributes are read-only in SCTM<br />Advantages<br />Folders / Requirements / Simulations / Scenarios are all imported as requirements<br />Attributes of folders and requirements<br />Attachments<br />Magnitude (imported as attribute for test)<br />Link to running visualization<br />Updated requirements from CaliberRDM automatically have new version created in SCTM<br />Manual requirement flagging capability in SCTM <br />Automatic with CalberRDM (new, updates, deleted)<br />Snapshot shows you the Visualization (simulations/scenarios) depending on the requirement types<br />Synchronization is performed at a project level (Global scheduled option and manual project sync)<br />Generate tests from requirements view in SCTM<br />SCTM allows you to open CaliberRDM / Generate Tests / Run Visualization (separate window)<br />
    76. 76. CaliberRDM Integration <br />CaliberRDM Integration points<br />Snapshot View – Visualization/Scenario<br />View CaliberRDM Scenarios and Visualizations<br />
    77. 77. SCTM Overview – Quality Goals (SCTM2010 R2)<br />Quality Goals (exit criteria) <br />definable set of testing metrics that the project must meet in order for the quality to be considered acceptable. Each Test Manager project can contain one or more quality goals. <br />In Test Manager, a quality goal is comprised of the following two elements: <br />A requirement or test definition. <br />A custom attribute or property of type List with a corresponding percentage value. <br />Quality Goal Example<br />If a requirement has a property of Risk with values of High, Medium, and Low, it should be possible to define a quality goal of: <br />Requirement Goal - Risk <br />High = 100% Medium = 50% Low = 10% <br />The 100% means that all of the tests that meet that criteria (linked to a requirement that has the High attribute value) must execute and pass to meet that goal. <br />
    78. 78. Quality Goals - Reporting<br />Execution Report<br />Planning Report<br />
    79. 79. SilkCentral Test Manager - Reporting<br />Actionable insight into quality management<br /><ul><li>Current trusted data
    80. 80. Across all ALM systems
    81. 81. Comparable with history views</li></li></ul><li>Increased efficiency and faster testing. Simplify testing activities and streamline execution using a single, unified test management framework.<br />Make better decisions. Gain visibility across projects and tool – regardless of the process used – uncovering key quality metrics.<br />Leverage legacy investments. Integrate and aggregate existing test frameworks, tools and assets.<br />Example: Lockheed Martin test timelines reduced from 70 person-days to 1 person-day; enabled two additional releases per year; ROI after one release.<br />Benefits of SilkCentral Test Manager<br />
    82. 82. Automated TestingSilkTest<br />
    83. 83. SilkTest 2010: Advancing the State of the Art in Automation<br />Visual Scripting<br />VB.NET Scripting<br />SilkTest Classic 4Test<br /><ul><li>Embrace different types of users
    84. 84. Provide appropriate and familiar scripting
    85. 85. Multi-language or visual scripting
    86. 86. Work environment – IDE or easy to use workbench</li></ul>Silk4NET<br />C#/VB.NET – VS2010<br />Silk4J<br />Java - Eclipse<br />
    87. 87. SilkTest Visual Scripting<br />Steps<br />Visualisation<br />Visualisation of Scripts, data and parameters<br />Facilitate Collaborations between teams<br />Full support of technologies<br />Storyboard<br />
    88. 88. SilkTest<br />Use the workflow bar to start graphically recording a functional script<br />Add value verifications at runtime. The auto-generated script can be modified in the SilkTest IDE if desired<br />
    89. 89. SilkTest<br />Use the data-driven workflow bar drive a test from external data such as spreadsheets or databases<br />
    90. 90. SilkTest<br />Scripts captured graphically can be saved to Eclipse to form part of a developers test suite – extending their unit testing<br />Full Eclipse IDE capabilities are available for editing and debugging the script<br />
    91. 91. SilkTest<br />Add new test Classes or Methods from within Eclipse<br />And record new “locators” to extend existing scripts.<br />
    92. 92. SilkTest<br />Run SilkTest scripts as part of a JUnit test framework – or from the test management solution.<br />
    93. 93. SilkTest Summary<br />SilkTest 2010<br /><ul><li>Easy, fast, reliable automation for repeatable, scalable testing
    94. 94. Industry leading Web 2.0 support
    95. 95. Superior object recognition</li></ul> Reliable tests<br />Tests that are resilient to change<br /><ul><li>Supporting a diversity of test automation users</li></ul>Scripting tailored to different users – Visual, VB.NET, Java<br />Workbenches tailored to different users<br /><ul><li>Automation reuse and sharing</li></li></ul><li>Consistent and repeatable results<br />Full cross browser AJAX support with completely automatic synchronization for testing asynchronous Web 2.0 applications<br />Increase productivity, lower costs: The fastest recording and execution of functional test scripts available today, in both Java and 4Test<br />Shorten test cycles: Advanced dynamic object recognition and synchronization for fast, stable, efficient, quality testing<br />Higher return on investment: Optimized testing for developers and testers in traditional and agile environments<br />Example: VMWare 60% improvement in QA productivity; regression testing 12x more productive.<br />Benefits of SilkTest<br />
    96. 96. Performance TestingSilkPerformer<br />
    97. 97. Silk Performer<br />Ensure applications meet scalability and performance targets<br />Accurately emulate thousands of real users without vast testing hardware requirements<br />Support for a broad array of technologies including the latest Web 2.0 / Rich Internet Applications<br />Ability to quickly pin-point performance bottlenecks and apply powerful diagnostics to resolve them<br />Streamlined and automated test creation<br />Comprehensive and automated reporting<br />61<br />
    98. 98. 4 Must Have Capabilities<br />SilkPerformer <br />Diagnostics<br />Integrated root cause diagnosis<br />SilkPerformer<br />CloudBurst<br />Pay as you go <br />peak demand emulation <br />SilkPerformer<br />Web 2.0 Support <br /> Fast and Accurate<br />Web 2.0 Load Testing<br />Silk Performance Assurance<br />Continuous Performance Testing<br />
    99. 99. SilkPerformer<br />Capture and customize scripts via a visual paradigm – TrueLog. Then show application state at precise moment of error.<br />
    100. 100. SilkPerformer<br />TrueLog on error allows easy identification of errors during load testing. Solve errors without repeating expensive load tests.<br />
    101. 101. SilkPerformer<br />Standard and easily customized reports for results analysis.<br />
    102. 102. SilkPerformer<br />Collect server-side monitoring metrics (disk, CPU, memory, database queues, etc.) and correlate them with load testing measures like timers, transactions, users. Find issues faster.<br />
    103. 103. SilkPerformer<br />BDLT allows more accurate testing of AJAX by measuring real user experience, including rendering time. <br />
    104. 104. SilkPerformer<br />Drill down from performance issue to application tiers, components and line of code<br />
    105. 105. Accelerates problem resolution -- by finding performance or scalability problems early in development cycles, often after just one load test<br />Reduce performance rework that slows down projects and eats software development budget<br />Enables quality and development personnel to collaborate and proactively resolve performance issues and deliver great performing applications<br />Increases the throughput of test centers<br />CloudBurst lets software quality teams instantly launch any size “peak demand” performance test for Internet-accessible applications without the cost and burden of managing complex infrastructures<br />Benefits of SilkPerformer<br />