2. 2
Agenda
• Introduction to CITGO
• CITGO’s Enterprise Application Landscape
• IT Business Needs and Drivers for Functional Test Automation
• Approach
• Results
– Business Process Coverage with Worksoft Certify®
– Efficiencies and Savings
– Planned Project Benefits
• Next Steps
– Future Automation Plans
– Expanding Automation Beyond SAP
3. CITGOToday
6thLargest and Most Complex Independent U.S. Refiner
• 3 refineries; combined refining capacity 749,000 BPD
• 27 states; more than 5,500 branded retail stations
• 48 petroleum product terminals; 9 pipelines
• 3 lubes blending and packaging plants
Sold 14.8 Billion Gallons of Refined
Products in 2014
3
5. • Payroll
• Benefits
• HR Systems
• Business Intelligence
• Master Data
• IT Security
• Financial Controls
SAP Scope of Business Functionality at CITGO
Refining
• Plant Maintenance
• Non-Hydrocarbon
Procurement
• Workorders
• Project Systems
• Non-Hydrocarbon
Inventory
• Rental Equipment
Tracking
Product and Crude Supply
• Trade Capture and Hydrocarbon Scheduling
• Hydrocarbon Inventory
• Exchanges & Terminal Agreements
• Pricing
• Crude Supply, Product Supply, PetroChem & Lubes
Marketing
• Light Oils Marketing
• Lubes Marketing
• Brand Development
• Payment Card
Operations
• Sales Reporting
• MarketNet
Corporate
Systems
• General Ledger
• Accounts Payable
• Accounts Receivables
• Fixed Assets
• Credit
• Consolidations
• Tax
• Cash Forecasting
• Banking
Terminals & Pipeline
• Data Gathering
• Billing
• Pricing
• Allocations
• Terminal Automation
5
6. CITGO Key Business Processes
• Enterprise Asset Management (EAM)
• Capital Asset Management (CAM)
• Environmental Health & Safety (EHS)
• Finance/ Controlling (FICO)
• Human Capital Management (HCM)
• Manufacturing (MFG)
• Master Data Management (MDM)
• Order to Cash (OTC)
• Plan to Make (PTM)
• Plan to Produce (PTP)
• Procure to Pay (PTP)
• Quality Management (QM)
• Requisition to Check (RTC)
• Sarbanes-Oxley Compliance (SOX)
• Inventory Management (IM)
6
Seeking high quality
business process
execution
7. CITGO Workstreams Across Functions and Units
• Security
• Human Resources
• Financials
• Hydrocarbon MM
• Lubes
• Non-Hydrocarbon
• Sales and Distribution Rack
7
Seeking high quality
business process
execution
8. IT Business Needs
• CITGO needed a solution to validate critical business processes in
order to avoid business disruption and improve quality when
deploying SAP software updates and technology changes.
• The automation platform had to be user friendly for business
analysts.
8
9. Drivers for Automation
Worksoft Certify® was selected to:
• Quickly build and maintain complex end-to-
end tests in CITGO’s environments
• Mitigate risk due to technology change
• Improve the quality of testing; reduce
production defects
• Maintain the integrity of existing systems
• Reduce testing cycles, resulting in faster
SAP upgrade projects
• Increase the level of formal testing on other
projects and support
• Deliver significant savings and efficiency in
business process validation
9
10. Approach
• Organizational and Team Structure Established
– Four governance group members
– Nine sub-committee members:
• Including two Worksoft Certify administrators for attribute updates, role
administration, monitoring and coordination of upgrades to Worksoft platform
• Governance Effort
Naming Standards: Establish standard variable naming conventions. For
example:
• Main Automated SAP Scenario for Transaction Code
• Automated SAP Scenario with child process
• Manual SAP Scenario
• Main Automated SAP Scenario for Integrated Processes
• Automated HR Scenario
• Non-SAP Automated Scenario (MarketNet)
10
11. Approach
• Governance Effort (continued)
Required Fields
• Differentiate process attributes
• Review and approve test scenarios
• Develop reporting criteria
• Train members on the Worksoft Certify software
• Recommend process improvements
Promote to Production
• Before moving to production folder, team leads will make sure all naming
conventions and required information are within the scenario
Folder Structures
• Two main folders to manage activity
– Citgo Development: Development sandbox for all test scenarios
– Citgo Production: Master file for all test scenarios, whether single
transaction or integrated
11
12. Worksoft Automation Capabilities
Integrated end-to-end testing across applications
Data driven testing
Use of recordsets
Data passing across processes
Dynamic capture of runtime generated data
Run time based data driven logic
Date & text manipulation
Screen captures & automated process document generation
Dynamic generation of real time test data
Reusable test asset creation
Handles advanced grid & tree controls
No programming skills required
12
13. Results
Business Process Coverage
• CITGO is using Worksoft Certify to automate the functional testing
of processes that support key areas in sales, purchasing, supply
chain, inventory and more
• 45%-50% of tests to support highly critical business processes
have been completed
• 769 of 1,910 business process scenarios covered in just 8 weeks
Greater Frequency in Quality Assurance & Defect Identification
• Previous testing was conducted only once per year; Worksoft
Certify is now used on a week-to-week basis
• Weekly testing supports day-to-day activities including
customization of reports, programming, running transactions,
problem solving, and more
13
14. Results (continued)
Efficiency and Time Savings
• Testing time is reduced from weeks to days, hours to minutes
• CITGO spends 3 months out of the year testing for yearly releases
• The company is on track to cut testing effort by 25% or more
with automation - replacing manual labor with digital labor
• Automation gives analysts time back – to focus on more strategic
projects.
• Initial project requires effort above the manual approach, but well
worth the time and investment
• Benefits will extend to subsequent projects
14
15. Results (continued)
Efficiency and Time Savings – by Workstream
Lubricant and Hydrocarbon process groups:
• Goal is to automate 85% of 1,060 test scenarios, reducing the number of
analysts needed to test and accuracy of testing
• Currently, 14 IT Analyst run full set of tests for 3 iterations of testing cycle
each year for SAP upgrade
• An 85 step business process was completed in less than a minute
• A 400 step business process was completed within two minutes
• Initial results: CITGO has converted 10-15% of test scenarios and
subsequently removed approx. 2 FTE weeks of testing through
efficiencies afforded by Worksoft Certify’s ability to link scenarios
• Worksoft Certify is being used for day-to-day program testing for “run the
business” activities
15
16. Results (continued)
Non-Hydrocarbon process group:
• Goal was to automate 60-70% of 850 test scenarios into approx. 50
Worksoft work process tests resulting in 3 FTE weeks of testing
• Approx. 10 full time equivalent (FTE) weeks of testing per each 850 test
iterative cycle
• Initial results: CITGO has converted 15-20% of test scenarios and
subsequently removed approx. 3 FTE weeks of testing through
efficiencies afforded by Worksoft Certify
• In addition to automation, Certify allows CITGO to test more wisely, spend
more time on critical process oversight and SAP updates
• End result: more thorough testing for the allotted time given to each
test cycle
16
17. Next Steps
• Further automation of business scenarios not covered during initial
project
• “Knitting” together CITGO unit tests to create additional end-to-end
business process tests
• Expanding use of automation beyond SAP
17