Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression and performance Testing.

World®
’16
Case Study: American Family Insurance Best
Practice for Automating Guidewire Testing
Sanket Shah - Test Automation Architect - American Family Insurance
DO5X20S
DEVOPS

2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type
of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation

Abstract
Sanket Shah (Lead Test Automation Engineer) discusses how his 30 member test
automation team facilitates Guidewire functional and regression testing as well as best
practices.
Automation is an accelerator, which fuels consistency, robustness and reliability in an
environment where tasks are to be repeated. One of the key advantages of it is in
automated regression testing, which saves a lot of effort in carrying out the same testing
activities repeatedly. Identifying any impacted integrated systems or the source system due
to change(s) in features/functionality and/or addition of feature/functionality in a software
product, would be a daunting task if carried out manually (especially when we want
consistency and when the AUT is integrated with several services at the application service
layer).
Leveraging automated regression testing would take the building up of API to a whole new
level, thus accelerating the user’s journey through their web application.
Sanket Shah
American Family Insurance
Test Automation Architect

Agenda
CASE BACKGROUND
CHALLENGES FACED
Q & A
INITIAL SOLUTION
DRAWBACK
ULTIMATE SOLUTION
1
2
3
4
5
6

Case Background

Billing and Policy Themes at Amfam
Strategic to the
Business
Optimizes
Customer
Experience
Transformational
to the business
Supports a
sophisticated
pricing model
Enhances
Amfam's brand
and market
leadership

Auto and Property Casualty Policy and Billing Testing Goals
POLICY
§ Reduce underwriting costs by
optimizing test case
efficiencies
§ Improve application quality /
reduce risk and impact of
defects
BILLING
§ Optimize customer e-Commerce and
Agent application experience (i.e.,
ensure a high quality user experience)
§ Reduce testing risk and duration: Build
automated test cases to support the
myriad of business processes (e.g.,
billing plans, exception handling, etc.)

Current Legacy Systems
Auto+
Property+
Customer Billing System (CBS)
POLICY MANAGEMENT BILLING

Migrating Legacy Systems to Open Systems
Auto+ and Property+ Customer Billing System (CBS)

Guidewire Policy Center
Issuance
Changes (charges/credits)
Cancellations (non-pay/insured)
Reinstates
Rewrites
Renewals

Guidewire Billing Center
§ Generate and bill invoices
§ Scheduling invoices
§ Accepting and applying payments
§ Payment reversals
§ Cancellation initiation (non-pay)
§ Delinquencies
§ Third party interest billing
management
§ Disbursements

A Policy’s Lifespan
6 to 12 months
12 months

PolicyCenter-BillingCenter Integration (Pre-Prod/Prod)
PolicyCenter BillingCenter
Database
Integration 1Integration 2
Integration 3
Integration 4
Integration 5
Integration 6 Integration 7
Integration 8
Integration 9

Challenges Faced

…in Testing BillingCenter in Pre-prod Tiers
Different teams testing different
application functionalities/
themes at the same time, which are
clock dependent.
Test scenarios to test a policy’s
state at a given point in time.
Clock dependency
of BC in pre-prod

Initial Solution

…to Test Clock Dependent Scenarios in BillingCenter
BC (deployed on local)Simulator
(simulating PC transactions
using spreadsheets as data
source and set of batch
files to load them)
L O C A L
H2

Steps Involved

…in Setting Up BillingCenter on Local for Testing Each
Scenario
Stop BC if
started
Drop DB Start BC Load initial data
Execute test
case
(~2-3 sec) (~1 sec) (~5 min)
(~2 min)
(Repeat the flow for each subsequent test scenario)

Drawback

…for Setting Up on Local
Execution time for
each scenario:
~9-10 min
Execution time for
100 scenarios:
~15-16 min

Solution à Retester Framework

What is Retester
§ In-house developed automation regression framework
§ In-depth verification of billing lifecycle of a policy
§ Simulation of policy transactions through APIs
§ Business friendly data entry forms
§ Production simulation of a real life business transaction
§ A layer of solidity before rolling out to larger audience
§ Robust, fast, consistent, repeatable

…a Comprehensive BillingCenter Application Testing Tool
MS Access forms to
enter scenarios
Oracle to store
scenarios data and
results
Automation tool as
master controller

Retester Framework – High level workflow
START
Get list of business
scenarios to be
executed
Execute pre-batch
events for current
day- all scenarios
Validate data for
the events pre-
batch and log
result
Advance clock and
run batch
Execute post-
batch events for
current day – all
scenarios
Validated data for
the events
executed post-
batch and log
results
Log events result
and validate result in
a database and
continue with next
day
End of
Test?
No
Yes
At end of the test,
send completion
email with
passed/fail stats
Log events result,
validate result in
database and
continue with next
day
END

Retester Framework – Detail Flow
START
Initialize day
counter
No
Yes
Get new test ID
for each
execution
Get max number
of days to
execute
currDay = currDay
+ 1
Get total
scenarios count
for currDay
Scenarios
exist for
currDay?
End of
Days?
Initialize
scenario
counter
currSce =
currSce + 1
A
A
End of
scenari
os for
curr
Day?
Get total pre-
batch events for
currDay and
currSce
Pre-
batch
events
exist?
Initialize event
counter
*
*
currEve = currEve
+ 1
A
Advance clock
and run EOD
batch
No
Yes
Scena
rios
Exist?
No
No
Get total post
batch events for
currDay and
currSce
Yes
Post-
batch
events
exist? No
Yes
Yes
B
END

DevTest from CA and Retester Framework
Uses PolicyCenter/
BillingCenter APIs
to initiate
transactions
Customized APIs to
validate data on
the BillingCenter
application
Creating new
scenarios is as
simple as filling
up a form
Cycles through
100s of scenarios
in < 2 hrs. Gain of
85%

Questions?

Recommended Sessions
SESSION # TITLE DATE/TIME
DO5T02P
Leadership Panel: DevOps Leaders Discuss the Journey to
Continuous Delivery
11/16/2016 at 01:45 pm
DO5T03P
Leadership Panel: Continuous Delivery in the Financial
Services Industry
11/16/2016 at 04:30 pm
DO5T14S
Continuous Delivery: Making DevOps Awesome
Nicole Forsgren – Theater 5
11/17/2016 at 10:30 am

Must See Demos
Modernize
App Delivery
Integrated CD
Theater 5 - DOV501P
Deliver Test
Data Faster
Test Data Manager
Theater 5 - DOV511P
Deliver
Better Apps
Service Virtualization
Theater 5 - DOV507P
Orchestrate
Your Release
Release Automation
Theater 5 - DOV513P

Stay connected at communities.ca.com
Thank you.

DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please
visit: http://cainc.to/PiTFpu

Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression and performance Testing.

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (19)

Similar to Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression and performance Testing.

Similar to Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression and performance Testing. (20)

More from CA Technologies

More from CA Technologies (20)

Recently uploaded

Recently uploaded (20)

Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression and performance Testing.