Submit Search
Upload
Combining qualitative and quantitative software process evaluation sylvie trudel
•
0 likes
•
261 views
IWSM Mensura
Follow
Presentation from the IWSM Mensura 2015 conference held October 5-7 in Cracow, Poland
Read less
Read more
Software
Report
Share
Report
Share
1 of 14
Download now
Download to read offline
Recommended
DMAIC Recap - ESTIEM Lean Six Sigma Green Belt Course
DMAIC Recap - ESTIEM Lean Six Sigma Green Belt Course
ESTIEM
Profolio
Profolio
VanWert
8D analysis presentation
8D analysis presentation
PRASHANT KSHIRSAGAR
Front-End Loading in the Oil and Gas Industry
Front-End Loading in the Oil and Gas Industry
David Pires
PAPER_CODE__IE12
PAPER_CODE__IE12
Prashant Uttarkar
Project Quality Management
Project Quality Management
asim78
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
GoLeanSixSigma.com
The New Face of Quality in Office and Service Environments
The New Face of Quality in Office and Service Environments
TKMG, Inc.
Recommended
DMAIC Recap - ESTIEM Lean Six Sigma Green Belt Course
DMAIC Recap - ESTIEM Lean Six Sigma Green Belt Course
ESTIEM
Profolio
Profolio
VanWert
8D analysis presentation
8D analysis presentation
PRASHANT KSHIRSAGAR
Front-End Loading in the Oil and Gas Industry
Front-End Loading in the Oil and Gas Industry
David Pires
PAPER_CODE__IE12
PAPER_CODE__IE12
Prashant Uttarkar
Project Quality Management
Project Quality Management
asim78
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
GoLeanSixSigma.com
The New Face of Quality in Office and Service Environments
The New Face of Quality in Office and Service Environments
TKMG, Inc.
Episode 23 : PROJECT TIME MANAGEMENT
Episode 23 : PROJECT TIME MANAGEMENT
SAJJAD KHUDHUR ABBAS
Quality engineering
Quality engineering
Quak Foo Lee ,MASc, LBBP, PM-LPC
360logica_Testing_center_of_excellence
360logica_Testing_center_of_excellence
guestf2e1db
Ch13 apqp
Ch13 apqp
Suresh Kothandaraman
Improving engineering productivity_loss_zhao-dungan
Improving engineering productivity_loss_zhao-dungan
ignitetribes
Phase gate review development model august 8 2017 - dave litwiller
Phase gate review development model august 8 2017 - dave litwiller
Dave Litwiller
QM-007-Design for 6 sigma
QM-007-Design for 6 sigma
handbook
LeanSigma for IW 2005
LeanSigma for IW 2005
Randall Cooper
Project management
Project management
AbhiMandyify
Quality Planning
Quality Planning
Firnando Buenayre
Basic SPC Training
Basic SPC Training
Tirupati kumar Tangellamudi
PMP Preparation - 08 Quality Management
PMP Preparation - 08 Quality Management
Mohamed ElSaadany, PMP, CCP, PMI-RMP, SCE-PE
CustomerCopy (1)
CustomerCopy (1)
Girish Gupta
Luis Navarro Resume
Luis Navarro Resume
Luis Navarro
Process Audit --VDA
Process Audit --VDA
Bill Yan
15 Deliv template
15 Deliv template
Leanleaders.org
Gray areas of vda 6.3 process auditors
Gray areas of vda 6.3 process auditors
Kiran Walimbe
Process auditing as per VDA 6.3
Process auditing as per VDA 6.3
Kiran Walimbe
Implementing lean Six sigma
Implementing lean Six sigma
sanobar77
White paper on Quality by Design
White paper on Quality by Design
Bir Gujral PhD, MBA
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development Performance
DCG Software Value
Study outbrief (v5)
Study outbrief (v5)
Glen Alleman
More Related Content
What's hot
Episode 23 : PROJECT TIME MANAGEMENT
Episode 23 : PROJECT TIME MANAGEMENT
SAJJAD KHUDHUR ABBAS
Quality engineering
Quality engineering
Quak Foo Lee ,MASc, LBBP, PM-LPC
360logica_Testing_center_of_excellence
360logica_Testing_center_of_excellence
guestf2e1db
Ch13 apqp
Ch13 apqp
Suresh Kothandaraman
Improving engineering productivity_loss_zhao-dungan
Improving engineering productivity_loss_zhao-dungan
ignitetribes
Phase gate review development model august 8 2017 - dave litwiller
Phase gate review development model august 8 2017 - dave litwiller
Dave Litwiller
QM-007-Design for 6 sigma
QM-007-Design for 6 sigma
handbook
LeanSigma for IW 2005
LeanSigma for IW 2005
Randall Cooper
Project management
Project management
AbhiMandyify
Quality Planning
Quality Planning
Firnando Buenayre
Basic SPC Training
Basic SPC Training
Tirupati kumar Tangellamudi
PMP Preparation - 08 Quality Management
PMP Preparation - 08 Quality Management
Mohamed ElSaadany, PMP, CCP, PMI-RMP, SCE-PE
CustomerCopy (1)
CustomerCopy (1)
Girish Gupta
Luis Navarro Resume
Luis Navarro Resume
Luis Navarro
Process Audit --VDA
Process Audit --VDA
Bill Yan
15 Deliv template
15 Deliv template
Leanleaders.org
Gray areas of vda 6.3 process auditors
Gray areas of vda 6.3 process auditors
Kiran Walimbe
Process auditing as per VDA 6.3
Process auditing as per VDA 6.3
Kiran Walimbe
Implementing lean Six sigma
Implementing lean Six sigma
sanobar77
What's hot
(19)
Episode 23 : PROJECT TIME MANAGEMENT
Episode 23 : PROJECT TIME MANAGEMENT
Quality engineering
Quality engineering
360logica_Testing_center_of_excellence
360logica_Testing_center_of_excellence
Ch13 apqp
Ch13 apqp
Improving engineering productivity_loss_zhao-dungan
Improving engineering productivity_loss_zhao-dungan
Phase gate review development model august 8 2017 - dave litwiller
Phase gate review development model august 8 2017 - dave litwiller
QM-007-Design for 6 sigma
QM-007-Design for 6 sigma
LeanSigma for IW 2005
LeanSigma for IW 2005
Project management
Project management
Quality Planning
Quality Planning
Basic SPC Training
Basic SPC Training
PMP Preparation - 08 Quality Management
PMP Preparation - 08 Quality Management
CustomerCopy (1)
CustomerCopy (1)
Luis Navarro Resume
Luis Navarro Resume
Process Audit --VDA
Process Audit --VDA
15 Deliv template
15 Deliv template
Gray areas of vda 6.3 process auditors
Gray areas of vda 6.3 process auditors
Process auditing as per VDA 6.3
Process auditing as per VDA 6.3
Implementing lean Six sigma
Implementing lean Six sigma
Similar to Combining qualitative and quantitative software process evaluation sylvie trudel
White paper on Quality by Design
White paper on Quality by Design
Bir Gujral PhD, MBA
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development Performance
DCG Software Value
Study outbrief (v5)
Study outbrief (v5)
Glen Alleman
Effective Test Estimation
Effective Test Estimation
TechWell
Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5
Skillogic Solutions
Fundamentals of Designing, Building, & Implementing a Service Delivery Center
Fundamentals of Designing, Building, & Implementing a Service Delivery Center
ScottMadden, Inc.
Spm ksp
Spm ksp
ktosri
Using Earned Value Management Concepts to Improve Commercial Project Performance
Using Earned Value Management Concepts to Improve Commercial Project Performance
LewisFowlerLLC
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
ESEM 2014
Furuyama - analysis of factors that affect productivity
Furuyama - analysis of factors that affect productivity
International Software Benchmarking Standards Group (ISBSG)
4. PAE AcFn621Ch-4a Project Alaysis and Selection.ppt
4. PAE AcFn621Ch-4a Project Alaysis and Selection.ppt
ProfDrAnbalaganChinn
Six sigma ajal
Six sigma ajal
AJAL A J
Dinesh Sharma and Jayeeta Dutta: Simplified Agile EVM - The Art Of Managing T...
Dinesh Sharma and Jayeeta Dutta: Simplified Agile EVM - The Art Of Managing T...
Lviv Startup Club
puneet_pall_resume
puneet_pall_resume
puneet pall
Renni Consultancy - Introduction
Renni Consultancy - Introduction
Divakaran Narasimhachari
Decision-Centric Dashboards with DMN at Two Fortune 200 Financial Companies
Decision-Centric Dashboards with DMN at Two Fortune 200 Financial Companies
Decision Management Solutions
Software Testing Process & Trend
Software Testing Process & Trend
KMS Technology
Resumepmlatest
Resumepmlatest
Rajasekar Sundarajan
Resume_Madhu Akkasali
Resume_Madhu Akkasali
Madhusudana Akkasali
Day 1 1620 - 1705 - maple - pranabendu bhattacharyya
Day 1 1620 - 1705 - maple - pranabendu bhattacharyya
PMI2011
Similar to Combining qualitative and quantitative software process evaluation sylvie trudel
(20)
White paper on Quality by Design
White paper on Quality by Design
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development Performance
Study outbrief (v5)
Study outbrief (v5)
Effective Test Estimation
Effective Test Estimation
Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5
Fundamentals of Designing, Building, & Implementing a Service Delivery Center
Fundamentals of Designing, Building, & Implementing a Service Delivery Center
Spm ksp
Spm ksp
Using Earned Value Management Concepts to Improve Commercial Project Performance
Using Earned Value Management Concepts to Improve Commercial Project Performance
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Furuyama - analysis of factors that affect productivity
Furuyama - analysis of factors that affect productivity
4. PAE AcFn621Ch-4a Project Alaysis and Selection.ppt
4. PAE AcFn621Ch-4a Project Alaysis and Selection.ppt
Six sigma ajal
Six sigma ajal
Dinesh Sharma and Jayeeta Dutta: Simplified Agile EVM - The Art Of Managing T...
Dinesh Sharma and Jayeeta Dutta: Simplified Agile EVM - The Art Of Managing T...
puneet_pall_resume
puneet_pall_resume
Renni Consultancy - Introduction
Renni Consultancy - Introduction
Decision-Centric Dashboards with DMN at Two Fortune 200 Financial Companies
Decision-Centric Dashboards with DMN at Two Fortune 200 Financial Companies
Software Testing Process & Trend
Software Testing Process & Trend
Resumepmlatest
Resumepmlatest
Resume_Madhu Akkasali
Resume_Madhu Akkasali
Day 1 1620 - 1705 - maple - pranabendu bhattacharyya
Day 1 1620 - 1705 - maple - pranabendu bhattacharyya
More from IWSM Mensura
When do software issues get reported in large open source software - Rakesh Rana
When do software issues get reported in large open source software - Rakesh Rana
IWSM Mensura
Accounting for non functional and project requirements - cosmic and ifpug dev...
Accounting for non functional and project requirements - cosmic and ifpug dev...
IWSM Mensura
Workshop early or rapid cosmic fsm - Frank Vogelezang
Workshop early or rapid cosmic fsm - Frank Vogelezang
IWSM Mensura
Tips and hints for an effective cosmic learning process gained from industria...
Tips and hints for an effective cosmic learning process gained from industria...
IWSM Mensura
The significance of ifpug base functionality types in effort estimation cig...
The significance of ifpug base functionality types in effort estimation cig...
IWSM Mensura
The effects of duration based moving windows with estimation by analogy - sou...
The effects of duration based moving windows with estimation by analogy - sou...
IWSM Mensura
Software or service that's the question luigi buglione
Software or service that's the question luigi buglione
IWSM Mensura
Requirements effort estimation state of the practice - mohamad kassab
Requirements effort estimation state of the practice - mohamad kassab
IWSM Mensura
Quantitative functional change impact analysis in activity diagrams a cosmi...
Quantitative functional change impact analysis in activity diagrams a cosmi...
IWSM Mensura
Practical usage of fpa and automatic code review piotr popovski
Practical usage of fpa and automatic code review piotr popovski
IWSM Mensura
Performance measurement of agile teams harold van heeringen
Performance measurement of agile teams harold van heeringen
IWSM Mensura
Measurement as-a-service a new way of organizing metrics programs - wilhelm m...
Measurement as-a-service a new way of organizing metrics programs - wilhelm m...
IWSM Mensura
Improving the cosmic approximate sizing using the fuzzy logic epcu model al...
Improving the cosmic approximate sizing using the fuzzy logic epcu model al...
IWSM Mensura
Functional size measurement for processor load estimation hassan soubra
Functional size measurement for processor load estimation hassan soubra
IWSM Mensura
From software to service sustainability a still broader perspective - luigi...
From software to service sustainability a still broader perspective - luigi...
IWSM Mensura
Estimation and measuring of software size within the atos gobal delivery plat...
Estimation and measuring of software size within the atos gobal delivery plat...
IWSM Mensura
Energy wasting rate jérôme rocheteau
Energy wasting rate jérôme rocheteau
IWSM Mensura
Do we measure functional size or do we count thomas fehlmann
Do we measure functional size or do we count thomas fehlmann
IWSM Mensura
Designing an unobtrusive analytics framework for monitoring java applications...
Designing an unobtrusive analytics framework for monitoring java applications...
IWSM Mensura
Automatic measurements of use cases with cosmic thomas fehlmann
Automatic measurements of use cases with cosmic thomas fehlmann
IWSM Mensura
More from IWSM Mensura
(20)
When do software issues get reported in large open source software - Rakesh Rana
When do software issues get reported in large open source software - Rakesh Rana
Accounting for non functional and project requirements - cosmic and ifpug dev...
Accounting for non functional and project requirements - cosmic and ifpug dev...
Workshop early or rapid cosmic fsm - Frank Vogelezang
Workshop early or rapid cosmic fsm - Frank Vogelezang
Tips and hints for an effective cosmic learning process gained from industria...
Tips and hints for an effective cosmic learning process gained from industria...
The significance of ifpug base functionality types in effort estimation cig...
The significance of ifpug base functionality types in effort estimation cig...
The effects of duration based moving windows with estimation by analogy - sou...
The effects of duration based moving windows with estimation by analogy - sou...
Software or service that's the question luigi buglione
Software or service that's the question luigi buglione
Requirements effort estimation state of the practice - mohamad kassab
Requirements effort estimation state of the practice - mohamad kassab
Quantitative functional change impact analysis in activity diagrams a cosmi...
Quantitative functional change impact analysis in activity diagrams a cosmi...
Practical usage of fpa and automatic code review piotr popovski
Practical usage of fpa and automatic code review piotr popovski
Performance measurement of agile teams harold van heeringen
Performance measurement of agile teams harold van heeringen
Measurement as-a-service a new way of organizing metrics programs - wilhelm m...
Measurement as-a-service a new way of organizing metrics programs - wilhelm m...
Improving the cosmic approximate sizing using the fuzzy logic epcu model al...
Improving the cosmic approximate sizing using the fuzzy logic epcu model al...
Functional size measurement for processor load estimation hassan soubra
Functional size measurement for processor load estimation hassan soubra
From software to service sustainability a still broader perspective - luigi...
From software to service sustainability a still broader perspective - luigi...
Estimation and measuring of software size within the atos gobal delivery plat...
Estimation and measuring of software size within the atos gobal delivery plat...
Energy wasting rate jérôme rocheteau
Energy wasting rate jérôme rocheteau
Do we measure functional size or do we count thomas fehlmann
Do we measure functional size or do we count thomas fehlmann
Designing an unobtrusive analytics framework for monitoring java applications...
Designing an unobtrusive analytics framework for monitoring java applications...
Automatic measurements of use cases with cosmic thomas fehlmann
Automatic measurements of use cases with cosmic thomas fehlmann
Recently uploaded
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
soniya singh
buds n tech IT solutions
buds n tech IT solutions
monugehlot87
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
stazi3110
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio, Inc.
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
Power Karaoke
What is Binary Language? Computer Number Systems
What is Binary Language? Computer Number Systems
JheuzeDellosa
What are the features of Vehicle Tracking System?
What are the features of Vehicle Tracking System?
Watsoo Telematics
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
MyIntelliSource, Inc.
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
Andreas Granig
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
VICTOR MAESTRE RAMIREZ
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
Wave PLM
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
AxelRicardoTrocheRiq
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
kellynguyen01
EY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
Neo4j
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
umasea
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
BradBedford3
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
Dinusha Kumarasiri
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
MyIntelliSource, Inc.
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
OnePlan Solutions
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
OPEN KNOWLEDGE GmbH
Recently uploaded
(20)
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
buds n tech IT solutions
buds n tech IT solutions
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
What is Binary Language? Computer Number Systems
What is Binary Language? Computer Number Systems
What are the features of Vehicle Tracking System?
What are the features of Vehicle Tracking System?
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
EY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
Combining qualitative and quantitative software process evaluation sylvie trudel
1.
15-‐10-‐12 1 COMBINING
QUALITATIVE AND QUANTITATIVE SOFTWARE PROCESS EVALUATION: A PROPOSED APPROACH Sylvie Trudel Dept. of Computer Science UQAM Alex Turcotte CEFTI Université de Sherbrooke 2© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW ² So)ware process evalua4on (SPE) ² Quan4fying the so)ware process efficiency ² Combining qualita4ve/quan4ta4ve SPE ² Field trial: financial trading domain ² Discussion ² Future work Content
2.
15-‐10-‐12 2 SOFTWARE
PROCESS EVALUATION (SPE) INTRODUCTION: WHY, WHO, HOW & HOW MUCH © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW 4 • Why: competition, market demands, costs – Symptoms: budget & schedule overruns (especially on larger projects), poor quality, unsatisfied customers/ users • How: evaluate against best practice models (e.g. CMMI) • Who: – Large organizations vs Small organizations: same methods? © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Understanding what needs to be improved
3.
15-‐10-‐12 3 5©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW CMMI Maturity Levels 1. Initial Unpredictable and Poorly Controlled 4. Quantitatively managed Controlled and Measured Process Predictable Process Process and Product Quality 5. Optimizing Emphasis on Process Improvement Continuous Improvement Process Change Management 2. Managed Reactive Project Defined Process Project Management Structured Process 3. Defined Proactive Organizational Defined Process Standard and Consistent Process Integrated Engineering Process 6© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Heroes1. Initial Level Emphasis 5. Optimizing Quantitative Management Basic Project Management Process Areas Decision Analysis and Resolution Risk Management Integrated Project Management for IPPD Organizational Training Organizational Process Definition Organizational Process Focus Validation Verification Product Integration Technical Solution Requirements Development Configuration Management Process and Product Quality Assurance Measurement and Analysis Supplier Agreement Management Project Monitoring and Control Project Planning Requirements Management Risks and Rework Organizational Process Performance Quantitative Project Management Organizational Innovation and Deployment Causal Analysis and Resolution Continuously Improving Processes Processes Standardization Productivity and quality Results 2. Managed 3. Defined 4. Quantitatively Managed CMMI-‐Dev Overview «Staged»
4.
15-‐10-‐12 4 Process
Evalua9on Methods 7© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Method Targeted organiza9ons Cer9fied lead appraiser Ra9ng Rela9ve cost SCAMPI ‘A’ Large þ þ $$$$$ SCAMPI ‘B’ Large þ -‐ $$$ SCAMPI ‘C’ Large & Medium -‐ -‐ $$ ISO/IEC 29110-‐3 Small -‐ -‐ $ PEM Small & Medium -‐ -‐ $ 8© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Original PEM Method (1 of 3) From ISO 14598-5 1- Analysis of Evaluation Requirements 2- Specification of the Evaluation 3- Design of the Evaluation • Evaluation request • Context: projects requirements, evaluation requirements • Statement of work template • SOW (draft) • CMMI Models • Process Area Selection Guide • Context • Statement of work (draft): ü Evaluation objectives ü Confidentiality agreement ü Assumptions and constraints • SOW (final) Scope: ü Selected Projects ü Selected Model ü Selected Process Areas • Client contract/agreement • SOW • Evaluation Plan Template • Evaluation Method • List of typical questions • Evaluation Plan • List of Selected Questions
5.
15-‐10-‐12 5 9©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Original PEM Method (2 of 3) From ISO 14598-5 (continued) 4- Interviewing Project Participants and Reviewing Project Documentation 5- Reviewing and Reporting Observations 6- Conclusion of the Evaluation Execution of the Evaluation • Interviews and Document reviews observations • Findings (draft) • Evaluator’s Checklist (started) • Evaluation Plan • List of Selected Questions • List of documents to evaluate • Evaluator’s Checklist (new) • Interview Guideline • Interviews and Document reviews observations • Wording of Findings Guideline • Findings (draft) • Finding Selection Guide • Evaluation Report Template • Evaluator’s Checklist (updated) • Evaluation Report (draft) • Findings (final and complete) • Evaluation Report (draft) • Requesters Comments • Evaluation Report (final) • Evaluator’s Checklist (final) • Interviews and Document reviews observations (destroyed) 10© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Original PEM Method (3 of 3) Value Added Step 7- Planning of Improvement Actions (optional) • Action plan, including: ü Related findings ü Activities, deliverables, tools ü Estimates and schedule ü Stakeholders involvement ü Return on investment • Evaluation Report (final) • Action plan template
6.
15-‐10-‐12 6 QUANTIFYING
THE SOFTWARE PROCESS EFFICIENCY HOW TO MEASURE ASPECTS OF THE SOFTWARE PROCESS ? © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW So)ware to measure Boundary COSMIC : Overview Func4onal process 1 Persistent storage Write (W) Read (R) Func4onal process 2 Func4onal process n … Human users or IO Hardware Entry (E) Exit (X) or Func4onal Users or Other systems Data ‘Interfaces’ ‘Infrastructures’ 12© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW
7.
15-‐10-‐12 7 13©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Applying COSMIC: 3 phases FUR Chapter 2 Measurement Strategy Generic Software Model Chapter 3 Mapping Phase FUR in the form of the Generic Software Model Chapter 4 Measurement Phase Functional size of the software in units of CFP Definition of each piece of software to be measured and of the required measurement Input from measurement sponsor Software Context Model FUR Poten4al measurement purpose: Quan4fy the SW process produc4vity rate Possible side effect: Iden4fy defects in Func4onal Requirements! COMBINING QUALITATIVE AND QUANTITATIVE SPE WHY AND HOW: A PROPOSED APPROACH… © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW
8.
15-‐10-‐12 8 15©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW ² Mo4va4ons: Ø Bring a broader insight on the SW Process Ø Overlooked issues related to requirements engineering Ø Provide a SW process produc4vity rate ² Hypothesis: Mutual influences between measurement results and qualita4ve findings Ø Requires to be combined during execu4on of the evalua4on! Combining Qualita9ve and Quan9ta9ve SPE 16© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Proposed approach 4a- Interviewing Project Participants and Reviewing Project Documentation 5- Reviewing and Reporting Observations Execution of the Evaluation • Interviews and Document reviews observations • Findings (draft) • Evaluator’s Checklist (started) • Evaluation Plan • List of Selected Questions • List of documents to evaluate • Evaluator’s Checklist (new) • Interview Guideline • Interviews and Document reviews observations • Wording of Findings Guideline • Findings (draft) • Finding Selection Guide • Evaluation Report Template • Evaluator’s Checklist (updated) • Evaluation Report (draft) • Findings (final and complete) 4b- Measuring software functional size and process efficiency • Selected FSM Method • FUR from selected projects • Effort from selected projects • Quality rating guidelines • Functional Size • Efficiency data (analysed) • Requirements defects (identified) • Findings (updated)
9.
15-‐10-‐12 9 FIELD
TRIAL: FINANCIAL TRADING DOMAIN WHAT WERE THE RESULTS? © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW 18© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW 1. Analysis: 100 staff members (most projects < 10) à trading SW for deriva4ve markets, documented process, percep4on of high costs from clients à Budget overruns on larger projects 2. Specifica4on: 1 Business domain (2 major clients), CMMI 2 & 3 except SAM-‐OT-‐DAR à 6 projects selected (3 large [500+ staff-‐ days], 3 regular) 3. Design: Plan to interview 21 par4cipants (at least 2 per role) à ques4onnaire developed, 2-‐page email instead of kick-‐off Organiza9on & Evalua9on Characteris9cs (1/2)
10.
15-‐10-‐12 10 19©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW 4. a. Interviews: 18 out 21 par4cipants interviewed, confiden4ality assured à effort = 50 staff-‐hours 4. b. Measurement: Done while reviewing requirements & projects documenta4on à ambigui4es led to examining SW code; results verified by cer4fied measurer, then analysis done 5. Review & Report: Valida4on of findings by par4cipants 6. Conclusion: Final report combines results à RE inconsistencies raised, recommenda4ons proposed for improvement Organiza9on & Evalua9on Characteris9cs (2/2) 20© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Ini4al produc4vity model with func4onal size and effort from all six projects
11.
15-‐10-‐12 11 21©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW Comparison of func4onal size and effort for the remaining four projects DISCUSSION AND FUTURE WORK WHAT DID WE LEARN AND WHAT’S NEXT? © TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW
12.
15-‐10-‐12 12 23©
TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW ² Adapta4on of PEM to combine qualita4ve (CMMI) and quan4ta4ve (COSMIC) evalua4on of the SW Process and the SW Requirements ² Several benefits from the field trial: 1. Measurement ßà Review of requirements quality (implicit) 2. Rela4on between measurement results and qualita4ve findings 3. Preliminary es4ma4on model obtained 4. Acceptable level of effort for a small organiza4on Discussion 24© TRUDEL & TURCOTTE 2015 IWSM MENSURA 2015 - CRACOW ² Adapt PEM from ISO/IEC 14598-‐5 to its updated SQuaRE version (i.e. ISO/IEC 25000) ² Verify compliance of PEM with ISO/IEC 15504 ² Include a customer sa4sfac4on survey to provide a 360˚ view of the SW process being evaluated Future Work
13.
15-‐10-‐12 13 25 26
14.
15-‐10-‐12 14 Thank
you ! 27
Download now