This document discusses three international use cases for new approaches to testing in heterogeneous environments. It summarizes the Dutch National Police use case of using NeoLoad software to test the performance of Citrix environments and Google Chrome browser performance. It also discusses using NeoLoad and Perfecto Mobile to test the end user experience of mobile applications on real devices.

1. Gian Giacomo Ermacora
giangiacomo.ermacora@emerasoft.com

2. Nuovi approcci al test in scenari eterogenei
Tre casi d’uso internazionali

4. Get the perfect insight of your user experience!

5. • An application that allows you to easily test the capabilities of an environment
• Vendor independent testing
• Focused on Citrix and Local Client environments
• Single point of administration
• Distributed computing using LoadBots
• Scalable up to thousands of users
• Measures user experience with response times
• End-to-end (E2E )monitoring functionality

7. Dutch National Police
• Largest employer in the Netherlands
• Citrix Domain Hosts 65.000 workspaces
• Divided over 7 data centers
• Roll out of new Citrix workspaces started in January 2015
• The roll out will take a few years and the existing Citrix environment must
be maintained
• Pressure on the Police organization due to political involvement
Use Case

8. Dutch National Police
Goals
• To determine the best performing Citrix workspace configuration
• To determine the maximum amount of users that can be hosted on one Citrix
Server with fair performance
• To test the performance of 3 business applications; all with other functional and
technical characteristics, deployed through Citrix
• E2E performance measurements (currently implementing)
• To determine the performance of Google Chrome for the existing Citrix
environment: use case

9. Dutch National PoliceGoogle Chrome
• Need for HTML5 deployed in Citrix
• In the ‘old’ Citrix workspace
environment
• Comparison: Google Chrome (latest
releases) & IE8 (common browser)
• With 65% regular users & 35%
heavy users
§ Memory of the Citrix servers is the main bottleneck
because of memory footprint Google Chrome
§ Processor and disks IO’s are bottlenecks too
§ Not possible to work with Chrome because of
instability it creates
§ Usage of other aplications failed because memory
drain by Chrome
Pains
Solu+on

12. Continuous Performance Testing
For Web and Mobile Apps

13. Fast & Automated
• Scriptless GUI-based design
• Continuous integration build server integration
• Enables you to test 30-50% faster
Supports the latest web and mobile application technologies
• Future-proof your load and performance testing toolbox
Unmatched test realism
• Complex application behaviors, real device test design, network emulation and real device metrics
under load
Cloud and in-house testing
• Single solution for in-house and cloud tests with on-demand cloud infrastructure
• Fully integrated with multiple cloud providers and geographies
Lower Total Cost of Ownership
• Get better results from fewer resources

14. ensure performance of internal and customer
facing applications
Enterprise level solution
Fast and easy to use
Advanced support of complex technologies
(HTML5, Oracle Forms)
Performance Testing Center of Excellence built around NeoLoad
Goals
Why Neoload:

15. Team
Member
1
Collaboration
Enables people to share and collaborate on testing assets
§ Share VUs profiles, test
scenarios, test results
§ Manage project versions / history
§ Administer users, roles and
permissions on NeoLoad projects
§ Automatically pull latest version
of a NeoLoad project when
executing tests
§ Enforce processes and standards
Design Scenario

16. Duration (in minutes) of 1 Typical Test Case with a Traditional Tool
15
60
15
90
30
60
15
60
45
15
30
15
60
15
20
15
60
30
Test Tunning
Test Tunning
Gain
of
(me
=
30%
+
Same
Test
Case
with

17. Better Apps Faster, No Compromising

18. …
And
ready
to
try
the
next
best
thing

19. Manual
Test
Test
Automa+on
Performance
App
Monitoring

20. Test end user experience of mobile application
Off the shelf integration with Perfecto Mobile
real device testing solution
Tes(ng
the
complete
mobile
end
user
experience
Goals
Why Neoload + Perfecto:
+

21. API CALL
XML/JSON RESPONSE
RENDERING
APPLICATION
What is a Mobile Response Time?

22. APP
SERVERS
NETWORK
APPLICATION
DEVICE/BROWSER
Complete Mobile EUE

23. NeoLoad + Perfecto Mobile
Real
Device
Tes(ng
Tool
Real
Device
Users
00:00:00
00:00:30
00:01:00
00:01:30
Load
NeoLoad
Applica+on
Server
App
Error
Rate
Virtual
Users
Load
Rendering
Time

24. Segui i nostri
canali!
www.emerasoft.com
sales@emerasoft.com
Emerasoft Srl
via Po, 1 – 10124 Torino
via del Poggio Laurentino, 118 – 00144 Roma
T +39 011 0120370
T +39 06 87811323
F +39 011 3710371
Grazie…
Contatti