The document discusses various types of testing for voice application including unit testing, functional testing, and load testing. Unit testing involves testing classes individually using a framework like RSpec. Functional testing uses tools like SIPp, ahn-loadbot, and PJSUA to test call flows. Load testing involves running high volumes of concurrent calls to test the system under heavy load. The document provides examples and best practices for each type of testing.

1. TESTING
ADHEARSION
APPLICATIONS
Luca
Pradovera
Voice
Applica1on
Developer
Mojo
Lingo
LLC
venerdì 1 marzo 13

2. About me
- Rubyist from Italy
- Voice Application
Developer at Mojo
Lingo
venerdì 1 marzo 13

3. ADHEARSION
DICTATION CARRIER
APPLICATIONS CALL APPS
CENTERS CRM
CUSTOMER SUPPORT
ARE
TRANSLATION FUN
DISTRIBUTED
C O M M U N I C A T I O N S
S C H E D U L I N G AND
CONVERGENCE
USEFUL
venerdì 1 marzo 13

4. BUT...
venerdì 1 marzo 13

5. THEY
MUST BE
STABLE!
venerdì 1 marzo 13

6. THE VILLAINS
- Application exceptions
- Wrong call flow
- Dropped calls
- Integration errors
venerdì 1 marzo 13

7. THE GOOD GUYS
- Unit Testing
- Functional Testing
- Load Testing
venerdì 1 marzo 13

8. UNIT TESTING
venerdì 1 marzo 13

9. Our goals for unit
testing:
- Confidence at the class level
- Prevent regression errors
- Promote proper code structure
- Provide CI with something to help us with
venerdì 1 marzo 13

10. Unit testing Ahn apps
- Call Controllers are an application’s core
- RSpec recommended
- Mock at the controller level
- Support classes are just Ruby!
venerdì 1 marzo 13

11. Adding RSpec
- Generated apps are
Gemfile: RSpec ready
group :test do
gem 'rspec'
- Your choice of mocking
end
framework
- Just bundle install
venerdì 1 marzo 13

12. Spec File
require 'spec_helper'
describe DemoController do
let(:mock_call) { mock 'Call' }
subject do
DemoController.new mock_call
end
let(:dtmf) { "1" }
it "should answer, ask for a result, and say it" do
subject.should_receive(:answer).once
subject.should_receive(:ask).with("What is your favorite number?", :timeout =>
10000, :limit => 1).once.and_return(dtmf)
subject.should_receive(:say).with("Your favorite number seems to be #{dtmf}")
subject.run
end
end
venerdì 1 marzo 13

13. Our controller
class DemoController < Adhearsion::CallController
def run
answer
result = ask "What is your favorite number?", :timeout =>
10000, :limit => 1
say "Your favorite number seems to be #{result}"
end
end
venerdì 1 marzo 13

14. Passing? COOL!
venerdì 1 marzo 13

15. FUNCTIONAL
TESTING
venerdì 1 marzo 13

16. Functional Testing
101
- Needs defining
- Quite difficult to approach
- Not solved by any single tool
venerdì 1 marzo 13

17. OK, WE ARE IN BAD
SHAPE...
venerdì 1 marzo 13

18. ...but here comes
some help!
SIPp
ahn-loadbot
PJSUA
venerdì 1 marzo 13

19. SIPp...
... is about as user friendly as the above lion.
venerdì 1 marzo 13

20. SIPp (seriously)
- http://sipp.sourceforge.net/
- Free and OSS Test tool and traffic
generator
- Can run XML scenarios defined by the user
- Can play audio and interact
- Requires good knowledge of SIP
venerdì 1 marzo 13

21. SIPp sample run
sudo sipp -sn uac -s 1 -l 10 -r 5 -m 100 127.0.0.1
- Built-in scenario
- Audio is PCAP, raw network capture of an
RTP session
- In custom scenarios, PCAP files are built
with Wireshark/tcpdump
- Ability to set call rate, concurrent calls,
maximum number of calls, many other
options
venerdì 1 marzo 13

22. SIPp options
- -trace_err gives you an error log
- -trace_stat outputs a CSV report
- -rtp_echo echoes RTP back to the source
- An XML scenario file can play PCAP, pause,
and perform general call control
venerdì 1 marzo 13

23. AHN-LOADBOT
venerdì 1 marzo 13

24. Friendly
Neighborhood Robot
venerdì 1 marzo 13

25. The LoadBot
- https://github.com/mojolingo/ahn-loadbot
- Adhearsion 1 plugin
- Drives calls though an Asterisk server
- Can simulate a call, listen for audio, and
record results
- Metrics that can be used: duration of calls,
ASR for presence of audio
venerdì 1 marzo 13

26. Loadbot scenario
config:
agi_server: 127.0.0.1
prefix: SIP/mycarrier
plans:
plan 1:
number: 1231231234
answers:
- 1
- Can be driven through DRb or directly
through the Ahn1 API
venerdì 1 marzo 13

27. PJSUA
venerdì 1 marzo 13

28. Someone has to
answer too!
venerdì 1 marzo 13

29. PJSUA at a glance
- Can make single or multiple connection to
SIP server
- Can auto-answer, play audio, and record
- Suitable for test support
- Also is a handy tool for QoS
- Does not run a “true” scenario
venerdì 1 marzo 13

30. Sample PJSUA
command line
pjsua --config-file options.conf
options.conf:
--null-audio
--realm adhearsion.com
--registrar sip.adhearsion.com
--id sip:999@adhearsion.com
--username 999
--password AdhearsionConf
--nameserver 8.8.8.8
--auto-answer 200
--auto-loop
--play-file monkeys.wav
venerdì 1 marzo 13

31. Functional
takeaways
- Set a specific goal for each scenario
- Take advantage of CDR and APIs to do
integration testing
- Less automated than web functional testing
venerdì 1 marzo 13

32. LOAD TESTING
venerdì 1 marzo 13

33. Is my system strong
enough?
venerdì 1 marzo 13

34. Load Testing is...
- Running a high amount of concurrent calls
- Decide what you are looking for
- Tool of choice, SIPp or Loadbot
venerdì 1 marzo 13

35. Load testing metrics
- Failed calls
- Average call times getting too long
- Exception tracking, not everything happens
visibly
venerdì 1 marzo 13

36. Thank you!
http://mojolingo.com
https://github.com/polysics
Twitter: lucaprado
XMPP and Email: lpradovera@mojolingo.com
...and please...
NO MAKE KITTY SAD
...go rate my talk at
http:/spkr8.com/17421
venerdì 1 marzo 13