• Save
Model based ttcn-3 testing of a mobile operator charging subsystem
Upcoming SlideShare
Loading in...5
×
 

Model based ttcn-3 testing of a mobile operator charging subsystem

on

  • 1,888 views

The presentation was initially made on The TTCN-3 User Conference in Beijing, China 2010. The customer in the case study was the largest Estonian mobile operator. ...

The presentation was initially made on The TTCN-3 User Conference in Beijing, China 2010. The customer in the case study was the largest Estonian mobile operator.
System under test in this case study was a postpaid data charging subsystem.
The core of the charging subsystem is the product of Ericsson and it is customized by our customer according their business rules.

Statistics

Views

Total Views
1,888
Views on SlideShare
1,320
Embed Views
568

Actions

Likes
0
Downloads
0
Comments
0

4 Embeds 568

http://www.elvior.com 550
http://www.elvior.ee 10
http://elvior.ee 4
http://elvior.com 4

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Model based ttcn-3 testing of a mobile operator charging subsystem Model based ttcn-3 testing of a mobile operator charging subsystem Presentation Transcript

  • Model-based TTCN-3 testing of a mobile operator charging subsystem T3UC, Beijing July 2010 Dr. Andres Kull, Elvior Dr. Kullo Raiend, Elvior
  • System Under Test ► Customer: Estonian mobile operator EMT (www.emt.ee) ► SUT: post-paid data charging subsystem in EMT ► CS: provided by Ericsson (www.ericsson.com) ► CS is customized using EMT business rules Billing Subsystem Charging Provisioning accumulators GSM/WCDMA SUT: Charging Subsystem Network Data session
  • CS core functionality ► Subscribers are provisioned by billing subsystem ► Provisioning the charging rules to the subscribers ► According to the data sessions the subscriber account is credited by CS Billing Subsystem Billing Sybsystem Charging Provisioning Charging reports Provisioning accumulators GSM/WCDMA GSM/WCDMA Data usage SUT: Charging Subsystem Charging Subsystem Network Network Data session
  • CS testing bottlenecks ► Ericsson upgrades CS software from time to time ► Customer introduces new subscription packages or changes existing ones from time to time ► Manual testing is time-consuming and error-prone ► Time for testing the updates is usually very short
  • Customer’s hopes from MBT ► Shorten the regression testing time ► Increase the test coverage ► Avoiding risks caused by the human factor in executing huge amount of boring tests manually ► Reducing the amount of manual tests significantly
  • MBT workflow used CS model in Poseidon for UML CASE tool Generator TTCN3- test scripts Develops Defines coverage CS Requirements Analyses ► System requirements are modelled TTCN-3 test tool ► Tests are generated from models ► Resulting tests have predefined coverage SUT: CS
  • CS features under test ► Subscribers provisioning ► Changing subscription profiles ► Changing month and day ► Bonus data amount usage ► Free data amount usage ► Priced data usage within HPLMN limit ► Priced data usage in the case of unlimited HPLMN ► Data usage if HPLMN limit is exceeded
  • Main test scenario TTCN-3 test tool Network Billing subsystem SUT: Charging Subsystem (CS) TTCN-3 test tool Billing subsystem Network Charging Subsystem (CS) Provision a subcsriber Generate data session Ask charging accumulators for the subscriber Charging accumulators Test if the subscriber account is credited as described by charging rules
  • CS model ► State machine models the behaviour of CS ► Only few model states (forBonus, forFree, noCharge, Priced, LimitExceeded) ► 16 context variables ► Properties of subscriber profiles ► CS accumulators for different purposes ► 106 transitions ► Express CS and environment transactions ► Used for modelling the charging rules
  • Tests generation and execution Coverage Generation Test lengh Amount of Execution time (transitions) TTCN-3 (LOC) time All transitions 2 min 213 9 213 5 min All transition 57 min 1 672 22 765 24 min pairs All transition 18 h 49 min 12 807 89 191 5h triples
  • Detected errors ► Note: CS was quite well manually tested before the MBT started ► In total 15 new errors were detected ► Detected charging errors could spoil the reputation of the operator
  • Project process, time spent ► Beginning (94 h, 31%) ► Introduction to problem domain ► Setting up test environment ► Executing 1st generated test case ► Incremental development to cover the scope (142 h, 47%) ► Model updates Results Results Model Results Model Model ► Test generation analysis analysis uddate analysis uddate uddate ► Test execution ► Analysing results Test Test Test Test Test Test executionexecutiongeneration execution generationgeneration ► Refactoring and test generation for different subscription profiles (32 h, 11%) ► Creating of documentation (32 h, 11%)
  • Test automation specialists feedback ► Higher test coverage than manually scripted ► The tests building productivity increases significantly ► Long generated test cases detected otherwise hard to find errors ► Significant tests maintenance costs decrease is foreseen ► Requirements traceability and results analysis is the key issue that should be improved in MBT
  • Conclusions ► Manual to MBT  reduces test quality decrease caused by human factor ► All transition test coverage tests allow quickly (5min) verify in regression test the past functionality ► MBT revealed significant amount of errors that were not disclosed in manual tests ► At the end of project the testing staff was convinced that CS is ready for taking into real use ► MBT is the technology that EMT will start to use
  • Thank you! More information: www.elvior.com Cut your sofware testing expenses Functional black-box tests automation