Key features of ElasTest for testing distributed applications

1. ElasTest: quality for cloud-
native applications
Patxi Gortázar
FIWARE Technical Steering Comitee meeting
14/10/2019
Funded by the
European Union
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

2. Cloud native applications

4. Cloud native applications

5. How’s the testing process?

6. Testing activities
Automated or manual testing
activities.
Collect information about the
running components during
the test run.
Fixing
Fix the error on the faulty
component and any other
components that might be
affected by these changes.
Submit the changes and re-
start the process.
Bug localization
Find the faulty
component(s) out of the
information provided by the
failed test.
03
01 02
How’s the testing process?

7. Exploratory
tests
E2E
tests
Integration
tests
Unit
tests
Understanding of
user impact
Understanding of
cause
With permission from
Rob Meaney

8. Current State of the Art

9. Build history divided by job steps

10. Limitations of logs in CI Servers
●
One huge log for all job
execution
– Dependencies downloading
– Compiling process
– Package process
– System deploying
– Finally…. test logs!

11. How do you analyze job log?
●
Using browser search tools (very limited)

12. Solution:
Observability + Analytics!!

15. ElasTest partners

16. SOFTWARE
LABORATORY
Cloud Computing & Microservices
Testing / Git / Jenkins / CI
Web Technologies & APIs
Extreme Programming
Concurrent & Distributed Systems
Software Architecture
http://codeurjc.es
CONSULTANCY & TRAININGMASTER CLOUD APPSPRODUCTS
Software quality
Backend technologies
Cloud & containers
CI / CD
100% Online / 1 year

17. What is ElasTest?
●
Open source platform for E2E testing of cloud
native applications
●
Capture relevant information (observability)
●
Mature platform (TRL 7-8)
– Pilots running at several companies
https://elastest.io

18. What is ElasTest?
●
Observability features
– Log and metrics visualization, recording and
management
– Log/Metrics analysis
– Log comparison

19. What is ElasTest?
●
Testability features
– Web browsers management
– Security testing
– IoT sensors & actuators emulation
– Jenkins integration
– Extensive documentation & tutorials

22. Easy adoption
●
Works with your current tests & Jenkins jobs
– With any programming language
– With any testing framework
– With your usual tools like Selenium

23. Log management
●
Comparing logs of a failed test with previous sucess
executions to spot the differences

24. Metric management
How difficult is
compare metrics
obtained with different
technologies or
parameters?

25. Demo
Testing with ElasTest

26. Start app
ElasTest configuration
SUT Indentification
https://github.com/codeurjc/expoqa19/blob/demo4/Jenkinsfile
node {
elastest(
tss: ['EUS'], monitoring: true, project: 'ExpoQA19'
surefireReportsPattern: '**/target/surefire-reports/TEST-*.xml', ) {
try {
stage("Preparation") {
git(
url: 'https://github.com/codeurjc/expoqa19.git',
branch: "demo4"
)
}
stage("Create jar") {
sh "docker-compose build"
}
stage("Start app") {
sh "docker-compose -p ${env.ET_SUT_CONTAINER_NAME} up -d"
}
stage("Test") {
sh "mvn test"
}
} finally {
sh "docker-compose -p ${env.ET_SUT_CONTAINER_NAME} down"
junit "target/*-reports/TEST-*.xml"
}
}
}

27. Log management
Job logs are managed in ElasTest

28. Search,
filter,
mark...
Log Analyzer

29. Tests comparison
Logs

30. Log and metrics integration

31. Tests comparison

32. Web browsers

33. Conclusions

34. Conclusions
●
Cloud native apps are complex distributed
applications
●
More difficult to E2E test than monoliths
(distributed systems falacies)
●
Observability during E2E testing is key

35. Conclusions
Observability
in production
Observability
for E2E testing!=

36. Conclusions

37. Conclusions
Live instance: http://live.elastest.io
ConclusionsConclusions
Web page: https://elastest.io
Docs & tutorials: https://elastest.io/docs/