Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Technische Universität München
Naming the Pain in Requirements
Engineering
Daniel Méndez
Technische Universität München
Ge...
Requirements Engineering in practice we have
experienced
Requirements Engineering in practice we have
investigated
Problem Statement
• Investigations in RE remain isolated
• Generalisations difficult as no (grounded) empirical survey basi...
Basic idea: Internationally distributed collaboration
Objectives
Approach: Structured family of surveys
1. Yearly collaborative instrument design
2. Yearly independent surveys ...
Our approach
InternationalReplication
GlobalReplication
ValidationPreparation
Germany International Communities
Conceptual...
ValidationPreparation
Germany International Communities
Conceptualisation
of research
questions Presentation &
discussions...
InternationalReplication
GlobalReplication
Initiation
First interpretation
Creation
Distribution List
Invitation
Synthesis...
Actually, we are
reaching this point...
Our approach
InternationalReplication
GlobalReplication
ValidationPreparation
Germ...
Instrument for NaPiRE - 2013
Research questions
1. What are the expectations on a good RE?
2. How is RE defined, applied, a...
First NaPiRE results from Germany
Study population
• German companies only
• Response rate: 55% (105 invitations, 78 parti...
First NaPiRE results from Germany
RQ 1: Expectations on good RE
What do you see as a barrier for an RE reference model?
I ...
First NaPiRE results from Germany
RQ 2: Status quo in RE
Workshops
Change Requests
Agile approaches
Prototyping
Other
0 20...
First NaPiRE results from Germany
RQ 3: Status quo in RE improvement
No prescreptive RE improvement
„I am not convinced of...
000
11
2
0
3
4
1
5
1
33
5
77
1
9
11
16
0
1
22
33
5
88
99
1111
12
1313
16
20
2222
31
First NaPiRE results from Germany
RQ 4...
Summary and future work
Summary of results
• Design of family of RE surveys
– Collaborative design of instrument
– Establi...
You are cordially invited to join us!
Daniel Méndez
Daniel.Mendez@tum.de
Stefan Wagner
Stefan.Wagner@informatik.uni-stuttg...
Upcoming SlideShare
Loading in …5
×

Naming the Pain in Requirements Engineering - Design of a Global Family of Surveys and First Results from Germany

220 views

Published on

Paper presentation given at the International Conference on Evaluation and Assessment in Software Engineering

Published in: Software
  • Be the first to comment

  • Be the first to like this

Naming the Pain in Requirements Engineering - Design of a Global Family of Surveys and First Results from Germany

  1. 1. Technische Universität München Naming the Pain in Requirements Engineering Daniel Méndez Technische Universität München Germany Design of a Global Family of Surveys and first Results from Germany Stefan Wagner University of Stuttgart Germany
  2. 2. Requirements Engineering in practice we have experienced
  3. 3. Requirements Engineering in practice we have investigated
  4. 4. Problem Statement • Investigations in RE remain isolated • Generalisations difficult as no (grounded) empirical survey basis available ➡Continuous replications necessary to steer (problem-driven) research
  5. 5. Basic idea: Internationally distributed collaboration
  6. 6. Objectives Approach: Structured family of surveys 1. Yearly collaborative instrument design 2. Yearly independent surveys in different countries 3.Yearly collaborative synthesis and publication Principles – Openness and transparency – Anonymity, but closed – Instrument based on theory and expectations www.re-survey.org (coming soon) Establishment of an open and generalisable survey basis for RE „Naming the Pain in Requirements Engineering“ (NaPiRE) ➡ Expectations and status quo in RE ➡ Problems and needs in RE
  7. 7. Our approach InternationalReplication GlobalReplication ValidationPreparation Germany International Communities Conceptualisation of research questions Presentation & discussions at communities Initial creation of questionnaire Internal validation External validation Industrial pilot Initiation First interpretation Creation Distribution List Implementation / correction Invitation Synthesis & reporting 1. Replication (Netherlands) Dissemination Creation distribution list Invitation Data analysis & interpretation Final reporting Online Survey Spreadsheet Data Analysis & Interpretation Creation Distribution List Invitation Creation distribution list Baseline Report Yearly RE Community Report ISERN '12 EESSMod (MoDELS '12) EASE '13 Replication Report Synthesis Survey Report Creation distribution list Invitation Data analysis & interpretation Planning PROMISE Repository Data Analysis & Interpretation Invitation Data analysis & interpretation
  8. 8. ValidationPreparation Germany International Communities Conceptualisation of research questions Presentation & discussions at communities Initial creation of questionnaire Internal validation External validation Industrial pilot Initiation First interpretation Implementation / correction 1. Replication (Netherlands) Creation distribution list Invitation Data analysis & Online Survey Spreadsheet Baseline Report ISERN '12 EESSMod (MoDELS '12) EASE '13 Creation distribution list Invitation Data analysis &
  9. 9. InternationalReplication GlobalReplication Initiation First interpretation Creation Distribution List Invitation Synthesis & reporting 1. Replication (Netherlands) Dissemination Creation distribution list Invitation Data analysis & interpretation Final reporting Data Analysis & Interpretation Creation Distribution List Invitation Creation distribution list Baseline Report Yearly RE Community Report EASE '13 Replication Report Synthesis Survey Report Creation distribution list Invitation Data analysis & interpretation Planning PROMISE Repository Data Analysis & Interpretation Invitation Data analysis & interpretation
  10. 10. Actually, we are reaching this point... Our approach InternationalReplication GlobalReplication ValidationPreparation Germany International Communities Conceptualisation of research questions Presentation & discussions at communities Initial creation of questionnaire Internal validation External validation Industrial pilot Initiation First interpretation Creation Distribution List Implementation / correction Invitation Synthesis & reporting 1. Replication (Netherlands) Dissemination Creation distribution list Invitation Data analysis & interpretation Final reporting Online Survey Spreadsheet Data Analysis & Interpretation Creation Distribution List Invitation Creation distribution list Baseline Report Yearly RE Community Report ISERN '12 EESSMod (MoDELS '12) EASE '13 Replication Report Synthesis Survey Report Creation distribution list Invitation Data analysis & interpretation Planning PROMISE Repository Data Analysis & Interpretation Invitation Data analysis & interpretation We are here...
  11. 11. Instrument for NaPiRE - 2013 Research questions 1. What are the expectations on a good RE? 2. How is RE defined, applied, and controlled? 3. How is RE continuously improved? 4. Which contemporary problems exist in RE, and how do they manifest themselves in the process? • Theory of expectations based on available surveys • Questionnaire with 35 questions • Closed and open questions • Implemented via the Enterprise Feedback Suite • Available at www.re-survey.org (soon) • Invitation of participants from existing research co-operations
  12. 12. First NaPiRE results from Germany Study population • German companies only • Response rate: 55% (105 invitations, 78 participants, 58 completed questionnaires) General characteristics • Most respondents in large enterpriese (median: 251-500 employees) • Most respondents work in globally distributed settings (97 %) • 80 % of respondents with more than 3 years of experience • 19 % customer role, 47 % role of contractor, 38 % product development Custom software development 36 % IT consulting 36 % Project management consulting 35 % Software process consulting 31 % Standard software development 28 % Embedded software development 7 % Main business area
  13. 13. First NaPiRE results from Germany RQ 1: Expectations on good RE What do you see as a barrier for an RE reference model? I disagree I agreeNeutral Missing willingness for change Higher process complexity Higher communication demand Missing possibility for standardisation Lower efficiency • RE improvement considered as most beneficial and most challenging • Important for RE reference model: Support for agility and guidance for tailoring • Biggest motivation for RE reference model: QA of artefacts Top rated answers in follow-up questions
  14. 14. First NaPiRE results from Germany RQ 2: Status quo in RE Workshops Change Requests Agile approaches Prototyping Other 0 20 40 60 80 How do you elicit your requirements? • Motivation for reference model: Company-specific demands (64%) • Tailoring: By project lead based on experiences (62%) • Control: Constructive quality assurance (53 %) % Top rated answers in follow-up questions
  15. 15. First NaPiRE results from Germany RQ 3: Status quo in RE improvement No prescreptive RE improvement „I am not convinced of the benefits of external standards.“ Detecting weaknesses Expected by customers Demanded by regulations 0 20 40 60 80 Motivation for an RE improvement Improvement methods (assessment & evaluation) Qualitative analyses Metrics 0 20 40 60 80 % %
  16. 16. 000 11 2 0 3 4 1 5 1 33 5 77 1 9 11 16 0 1 22 33 5 88 99 1111 12 1313 16 20 2222 31 First NaPiRE results from Germany RQ 4: Contemporary problems in projects Overall frequency Cause for project failure Incomplete/ hiddenreqs. Moving targets Time boxing Separationreqs. fromsolutions Underspecified reqs. Communication flawstocustomer Inconsistentreqs. Communication flawsinteam Missingtraceability Gold plating Unclearnon- functionalreqs. Terminological problems Insufficientsupport bycustomer Unclear responsibilities Volatile domain Weakaccessto customerneeds Insufficientsupport byprojectlead Technically unfeasiblereqs. Innovationvs. formalacceptance Weakrelationship tocustomer Weakdomain knowledge - Interpretation: Need for agility? - Interpretation: Need for artefact definition and QA?
  17. 17. Summary and future work Summary of results • Design of family of RE surveys – Collaborative design of instrument – Establishment of infrastructure • First results from Germany (completed) • First replication in Netherlands (ongoing) Next steps planned for ISERN 2013 • Synthesis of studies, publication, and disclosure of data to PROMISE repository • Organisation of thematic workshop – Adjust instrument – Define process for replications – Provide infrastructure
  18. 18. You are cordially invited to join us! Daniel Méndez Daniel.Mendez@tum.de Stefan Wagner Stefan.Wagner@informatik.uni-stuttgart.de

×