This master's thesis discusses the integration of performance awareness into the software specification process at the University of Stuttgart. It highlights the significance of performance prediction and modeling, the challenges of implementing these concepts in development environments, and a framework for performance analysis through the DECLARE project. The document concludes that while real-time diagnostics and variability analysis are achievable, further analysis for incomplete configurations is still needed.

1. Introducing
Performance Awareness
in an Integrated
Specification
Environment
Master‘s Thesis / University of Stuttgart
May – November, 2016
Fabian Keller

2. Introducing Performance Awareness in an Integrated Specification Environment 2
Fabian Keller
University of
Stuttgart
D-70569 Stuttgart
Markus Völter
voelter –
Ingenieurbüro für
Softwaretechnologie
D-70327 Stuttgart
André van Hoorn
University of
Stuttgart
D-70569 Stuttgart
Klaus Birken
itemis AG
D-70565 Stuttgart
Hello

3. Building Software with
Performance in Mind
State of the Art
Introducing Performance Awareness in an Integrated Specification Environment 3

4. Introducing Performance Awareness in an Integrated Specification Environment 4
Performance prediction at its finest
Palladio
Becker et al. [2009]

5. Introducing Performance Awareness in an Integrated Specification Environment 5
Or how to ship performant code
Software Performance Engineering
RE

6. Introducing Performance Awareness in an Integrated Specification Environment 5
Or how to ship performant code
Software Performance Engineering
RE
SPL

7. Introducing Performance Awareness in an Integrated Specification Environment 5
Or how to ship performant code
Software Performance Engineering
RE
SPL
SA

8. Introducing Performance Awareness in an Integrated Specification Environment 5
Or how to ship performant code
Software Performance Engineering
RE
SPL
SA
NFR

9. Introducing Performance Awareness in an Integrated Specification Environment 5
Or how to ship performant code
Software Performance Engineering
RE
SPL
SA
NFR
IDE

10. Introducing Performance Awareness in an Integrated Specification Environment 6
Integration of performance awareness in Java EE development
environments
– Chrusciel, 2015 –
Related Work

11. Introducing Performance Awareness in an Integrated Specification Environment 7
In Situ Understanding of Performance Bottlenecks through Visually
Augmented Code – Beck et al., 2013 –
Related Work

12. Room for Improvement?
Motivation
Introducing Performance Awareness in an Integrated Specification Environment 8

13. Straight from the ISE*, not IDE
Performance Awareness
Introducing Performance Awareness in an Integrated Specification Environment 9
* ISE = Integrated Specification
Environment

14. Straight from the ISE*, not IDE
Performance Awareness
Introducing Performance Awareness in an Integrated Specification Environment 9
* ISE = Integrated Specification
Environment

15. Introducing Performance Awareness in an Integrated Specification Environment 10
Variability analysis
Software Product Lines

16. • What impact does this decision have on the performance?
• Are all performance requirements fulfilled?
• Are all performance requirements fulfilled for all relevant configurations?
• Having an incomplete configuration, which features yield the best
performance?
• Oh this is interesting, can we have a thorough analysis?
Introducing Performance Awareness in an Integrated Specification Environment 11
Immediate feedback raises performance awareness
Questions

17. Overview & Infrastructure
Approach
Introducing Performance Awareness in an Integrated Specification Environment 12

18. Introducing Performance Awareness in an Integrated Specification Environment 13
Modeling components
JetBrains MPS and IETS3

19. Introducing Performance Awareness in an Integrated Specification Environment 13
Modeling components
JetBrains MPS and IETS3

20. Introducing Performance Awareness in an Integrated Specification Environment 14
Modeling systems
JetBrains MPS and IETS3

21. Introducing Performance Awareness in an Integrated Specification Environment 14
Modeling systems
JetBrains MPS and IETS3

22. Modeling resources and allocations
JetBrains MPS and IETS3
Introducing Performance Awareness in an Integrated Specification Environment 15

23. Modeling resources and allocations
JetBrains MPS and IETS3
Introducing Performance Awareness in an Integrated Specification Environment 15

24. Introducing Performance Awareness in an Integrated Specification Environment 16
Use cases and requirements
JetBrains MPS and IETS3

25. Introducing Performance Awareness in an Integrated Specification Environment 16
Use cases and requirements
JetBrains MPS and IETS3

26. Introducing Performance Awareness in an Integrated Specification Environment 17
Open source: github.com/DECLARE-Project
Projects

27. Define Performance Analyses
Introducing Performance Awareness in an Integrated Specification Environment 18
A framework for model-agnostic performance analysis
fastpan
PerformanceAnalyz
er
AnalysisContext PerformanceResult
DECLARE-
Project/fastpan

28. Define Performance Analyses
Define Variability Analyses
Introducing Performance Awareness in an Integrated Specification Environment 18
A framework for model-agnostic performance analysis
fastpan
PerformanceAnalyz
er
AnalysisContext PerformanceResult
VariabilityAnalyzer VariabilityContext ?
DECLARE-
Project/fastpan

29. Define Performance Analyses
Define Variability Analyses
Performance result standard (semantics!)
Introducing Performance Awareness in an Integrated Specification Environment 18
A framework for model-agnostic performance analysis
fastpan
PerformanceAnalyz
er
AnalysisContext PerformanceResult
VariabilityAnalyzer VariabilityContext ?
Attach.<NamedElement>to(action).utilization(Percentage.of(result.getUtilization())).mean();
Attach.<NamedElement>to(action).serviceTime(serviceTime).normalDistribution(serviceTimeVariance))
PerformanceMetric
PerformanceMeasu
re
DECLARE-
Project/fastpan

30. palladio-environment
• Use Palladio outside Eclipse (i.e. headless)
palladio-builder
• Build PCM models with fluent Java API
palladio-analysis
• Supports LQN solver
• Implements fastpan PerformanceAnalyzer
Introducing Performance Awareness in an Integrated Specification Environment 19
Palladio outside Eclipse
palladio-headless
DECLARE-Project/palladio-
headless

31. Introducing Performance Awareness in an Integrated Specification Environment 20
palladio-environment implementation
palladio-headless
Contributions are
welcome!

32. Introducing Performance Awareness in an Integrated Specification Environment 20
palladio-environment implementation
palladio-headless
Contributions are
welcome!

33. Model-to-model
transformation
IETS3 =?= PCM
Introducing Performance Awareness in an Integrated Specification Environment 21

34. Mapping Processors
M2M Transformation
Introducing Performance Awareness in an Integrated Specification Environment 22

35. Mapping Processors
M2M Transformation
Introducing Performance Awareness in an Integrated Specification Environment 22

36. Introducing Performance Awareness in an Integrated Specification Environment 23
Resources
M2M Transformation

37. Introducing Performance Awareness in an Integrated Specification Environment 23
Resources
M2M Transformation

38. Live Demo
Oh yeah!
Introducing Performance Awareness in an Integrated Specification Environment 24

39. Results & Conclusion
Almost there

40. Round-trip analysis time
Evaluation
Introducing Performance Awareness in an Integrated Specification Environment 26

41. • Palladio can provide real-time diagnostics
• Variability analysis in IETS
3
• [Yes] What impact does this decision have on the performance?
• [Yes] Are all performance requirements fulfilled?
• [Yes] Are all performance requirements fulfilled for all relevant
configurations?
• [Not yet] Having an incomplete configuration, which features yield the best
performance?
Results & Conclusion
Introducing Performance Awareness in an Integrated Specification Environment 27

42. • Slide 1: https://commons.wikimedia.org/wiki/File:Fale_F1_Monza_2004_73.jpg
• Slide 4: Becker, Steffen, Heiko Koziolek, and Ralf Reussner. "The Palladio component
model for model-driven performance prediction." Journal of Systems and Software 82.1
(2009): 3-22.
• Slide 5: Doors Screenshot:
https://www.ibm.com/developerworks/mydeveloperworks/blogs/requirementsmanageme
nt/resource/BLOGS_UPLOADED_IMAGES/seg2.jpg
• Slide 5: ArchStudio Screenshot:
http://y.web.umkc.edu/yzheng/img/archfeature/ArchFeature.PNG
• Slide 5: EnterpriseArchitect Screenshot:
http://assets.devx.com/articlefigs/Fig3_DetailedClassDiagrams.jpg
• Slide 5: Palladio Bench Screenshot: http://sdq.ipd.kit.edu/uploads/media/palladio-
bench_3.4_screenshot_01.jpg
• Slide 5: IntelliJ IDEA Screenshot:
https://www.jetbrains.com/idea/img/screenshots/idea_overview_5_1@2x.png
Introducing Performance Awareness in an Integrated Specification Environment 28
Image References