Originally presented on September 21, 2016 at SAP TechEd by Deborah Rogers, QA & Automated Test Lead at Newport News Shipbuilding.

1. Newport News Shipbuilding
Takes the Pain out of
Compliance & Testing
September 21, 2016, SAP TechEd Conference
Deborah Rogers
QA & Automated Test Lead

2. 22
Agenda
• Intro to NNS
• NNS Applications
• Takeaways Summary
• Business Needs & Drivers for Functional Test Automation
• Automation Goals
• Approach
• Project Benefits
• Results
• Best Practices
• Future Plans & Expansion

3. 3
Who We Are – Our Business
• Over a century designing, building, overhauling and repairing
ships for the U.S. Navy, the U.S. Coast Guard and world
navies
• The nation's sole industrial designer, builder and refueler of
nuclear-powered aircraft carriers
• One of only two companies capable of designing and building
nuclear-powered submarines
• One of the nation’s leading providers of major surface
combatants (destroyers, cruisers, high endurance cutters, and
amphibious assault ships) for the U.S. and international
navies
• Have built over 40 percent of the U.S. Navy’s current surface
combatant fleet
• After-market services – maintenance, repair, and overhaul –
support a wide array of naval and commercial vessels
• A wide variety of products and services to the commercial
energy industry and other government customers, including
the Department of Energy

4. 4
Core Competencies
Leveraging our world-class facilities, highly skilled workforce
and culture of safety, ethics and compliance
Nuclear Operations
Heavy Manufacturing
Engineering &
Program Management

5. 5
Huntington Ingalls Facts
• Annual revenues of approximately $7 billion and current backlog of $21.3 billion
• Employees: approximately 35,000; largest industrial employer in Virginia, largest
private employer in Mississippi
• Key Locations:
– NEWPORT NEWS SHIPBUILDING
• Newport News, VA (Nuclear Aircraft Carriers, Submarines, Overhaul)
• Virginia Beach, VA (AMSEC, Fleet Support)
• San Diego, CA (Continental Maritime of San Diego, Fleet Repair & Support)
• Broomfield, CO (SN3, Nuclear Facility Management and Environmental
Remediation)
• Panama City, FL (Undersea Solutions Group, Manned and Unmanned Undersea
Vehicles)
• Houston, TX (UniversalPegasus International, Engineering and Project
Management Services to Domestic and International Energy
Markets)
– INGALLS SHIPBUILDING
• Pascagoula, MS (Surface Combatants, Amphibs, CG large cutters)
The Nation’s Leading Military Shipbuilder

6. 6
Newport News Shipbuilding
• Sole supplier of U.S. Navy Aircraft Carriers
• One of two builders constructing Virginia-
Class nuclear submarines
• Exclusive provider of refueling services for
nuclear-powered aircraft carriers
• Largest non-governmental provider of fleet
maintenance services to the Navy
• Largest industrial employer in Virginia –
about 20,000 employees
• Home of one of the Western Hemisphere’s
largest dry docks and cranes

7. 77
What You Will Learn Today
• How Newport News Shipbuilding uses automation for stress-free
SOX compliance
• How functional test automation enables over 80% time savings with
every regression testing cycle
• How automated business process testing keeps customers happy
with reliable quality across EHS, Payroll, and Materials Management
processes

8. 88
Key Takeaways
• Learn how you can support compliance with business process
documentation, easy-to-capture screenshots and compliance data
that make your life and your auditor’s lives easier
• See how to accelerate regression testing cycles so that your team
can spend more time on value-added activities and less on manual
tasks
• Discover how to avoid testing in silos, quickly uncover defects,
improve quality, and achieve high test coverage even in the face of
continuous system changes

9. 99
NNS Applications
• SAP®
– including modules for HR, Payroll, Finance, Planning, Scheduling,
Materials, EH&S
• .NET
• Mainframe
• C#
• Teamcenter®

10. 1010
Business Needs & Drivers for Functional Test Automation
• NNS required a solution to regression test SAP Support Packs
• Needed end-to-end testing to ensure processes flowed across the
enterprise landscape
• Required a tool that could not only support SAP, but also Teamcenter
and Windows®
• Desired a solution with no coding involved; Wanted functional team
members to be comfortable without the need to learn dedicated
programming skills

11. 1111
Automation Goals
• Validate critical business processes to avoid business disruption
• Reduce production defects; Improve the quality of testing
• Quickly build and maintain complex end-to-end tests
• Maintain the integrity of existing systems
• Reduce testing cycles
• Save time and money
• Replicate tests the same way every time for greater confidence

12. 1212
Approach
• Organization & Executive Support: Established support from CIO,
Systems Engineering, and Software Development
• Project Start Up & Training: Initially gathered the end-to-end
workflow processes with the input of 20 team members.
– Today only one person manages the “cradle to grave” tests.
• Building the Automation Portfolio: Developed a centralized, robust
library of mission critical repeatable tests, sorted by business process

13. 1313
Audit Documentation for SOX Compliance
Screen shots obtained from a demonstration Worksoft system

14. 1414
Audit Documentation for SOX Compliance
Screen shots obtained from a demonstration Worksoft system

15. 1515
Goods Receipt with Execution Log
Screen shots obtained from a demonstration Worksoft system

16. 1616
Time Entry with Execution Log
Screen shots obtained from a demonstration Worksoft system

17. 1717
Planning Run with Execution Log
Screen shots obtained from a demonstration Worksoft system

18. 1818
MRP List with Execution Log
Screen shots obtained from a demonstration Worksoft system

19. 1919
Approach
• Moving to Automated Document Generation: Used Worksoft Certify
Business Process Procedure™ (BPP) to create automated
documentation for auditors to ensure SOX compliance
– BPP is very customizable; Ability to include use filters; Include an
expansive level of detail
– Screen shots are saved with testing steps
– System used to capture before and after screen shots (which are
timely to produce manually)
– Automated system set up to collect critical data
– Technical level of detail is critical for auditors

20. 2020
Certify Business Process Procedure
Screen shots obtained from a demonstration WorkSoft system

21. 2121
Certify BPP Template List
Screen shots obtained from a demonstration WorkSoft system

22. 2222
Audit Documentation for SOX Compliance

23. 2323
Results
Business Process Coverage
• NNS is using Worksoft Certify® to automate the functional testing of processes
that support key areas in Planning, Scheduling, Materials Management, Group
Pegging and Distribution, Inventory management, Payroll, Radiological controls
• 90% of tests to support highly critical business processes have been completed
• 47 business process scenarios (workstreams) covered
Greater Frequency in Quality Assurance & Defect Identification
• 200 regression tests run 6 times a year, every other month.
• Previously 16 team members ran tests manually – spending 177 hours.
• Staff has their time back. Now, automated run time is less than 40 hours. This
includes time spent on “fixes” and repairs.
• Testing prior to releases uncovers defects headed for production. Team able to
catch and fix before production.

24. 2424
Project Benefits
• Reduced Test Cycles: Regression testing time is reduced from 4 weeks
to 1 week
• Time Savings: 80% time savings
• More Defects Uncovered: defects detected before entering production
(greater defect removal efficiency)
• Getting Time Back: Systems engineers and software development
analysts were both needed for testing previously. Now systems engineers
are dedicated to other higher value-added projects
• Improved Quality: More comprehensive, reliable test coverage for EHS,
Payroll, and Materials Management business processes
• Capturing “Tribal” Knowledge: Knowledge has been centralized &
documented

25. 2525
Best Practices & Learnings
• Training is Key: NNS arranged for 20-30 team members to be
available part-time over a 6 week time frame to get mission-critical
tests up and running; Create a central resource for knowledge.
• Map Out Business Processes: Take the time to do this. Key
learnings take place during the process!
• Utilize Experts: NNS subject matter experts and a Worksoft
consultant worked closely to map the connections of each system
across the enterprise landscape. This core understanding was critical
for fast start up.

26. 2626
Future Plans & Expansion Beyond SAP
Increase Customization of SOX Compliance Documentation
• Want to continue to impress auditors with comprehensive data
Expansion in Testing Beyond SAP
• Plans for C#, .net, mainframe applications testing
• Teamcenter (Siemens PLM)

27. 2727
Citations
• SAP® is the registered trademark of SAP SE in Germany and in several other countries.
All SAP screen shots used with permission from SAP SE.
• Worksoft® Worksoft Certify® and Worksoft Certify Business Process Procedure® are
registered trademarks of Worksoft, Inc.
All Worksoft screen shots used with permission from Worksoft, Inc.
• Teamcenter® is a registered trademark of Siemens Product Lifecycle Management
Software Inc.
• Windows® is a registered trademark of Microsoft.
• Individual elements of this presentation may not be copied or distributed without the
express written consent of Huntington Ingalls Industries.