Is Reliability Centered Maintenance (RCM) right for you?Nancy Regan
This presentation outlines the goals of a Reliability Centered Maintenance (RCM) analysis. It debunks the top misconceptions about RCM. And it poses and answers the top four questions about RCM most people don’t know to ask.
John Day developed a proactive maintenance process in 1978 and manage maintenance and engineering at Alumax Mt. Holly and later at Alcoa Mt Holly for over 20 years. These are the slides he presented at the 1997 SMRP Conference. Great slides with great information. If you would like the slides and not PDF send me an email at rsmith@maintenancebestpractices.com. I worked for John Day back in the early 1980s which started my journey in Proactive Maintenance.
Module: EThICS 039.BC02E.07_LCPP_Conc & Princ_LCC & Effectiv
Topic: LIFE CYCLE OF PROJECTS AND PRODUCTS
Subject: Concepts and Principles of Life Cycle Cost (LCC) and Effectiveness
Scope:
PURPOSES OF THE MODULE
INTRODUCTION
Acronyms
Motivations for LCC and Effectiveness
Standards for LCC
BASIC CONCEPTS OF LCC
Elements of Life Cycle:
Life Cycle
Fig. 1: Model of Life Cycle of Projects and Products
Fig. 2: Initial Steps of RDI of Systems and Products
Acronyms of RDI
Elements of Life Cycle Cost:
Cost Driver
Cost Profile
CBS – Cost Breakdown Structure
Recurrent Costs
Non-Recurrent Costs
Fig. 3: Elements of Life Cycle Costs
LCC – Life Cycle Cost
Life Cycle Costing
TLC - Through-Life Cost
WLC - Whole-Life Cost
WLCC - Whole-Life Cycle Costing
TCO – Total Cost of Ownership
TCA – Total Cost of Acquisition
COO – Total Cost Of Operations
LAC - Life Acquisition Cost
LOC - Life Ownership Cost
LLC - Life Loss Cost
LCCA – Life Cycle Cost Analysis
CONCEPTS OF EFFECTIVENESS
Elements of Effectiveness
Effectiveness Analysis
System Effectiveness
Fig. 4: FOM - Factors Of Merit
MOE - Measure Of Effectiveness
Operational Effectiveness
Elements of Operational Effectiveness
Operational Suitability
MOS - Measure Of Suitability
Operational Availability
Operational Utility
Cost Effectiveness
CONCEPTS OF PERFORMANCE
Elements of Performance
Performance
System Performance
Level of Performance
Categories of Performance
Objective Performance
Subjective Performance
System Attributes
Attributes of Operational Performance
Physical Attributes
Functional Attributes
MOP - Measures Of Performance
MODELS OF LCC
Fig. 5: Summary Vision of Total Costs of the Life Cycle
Model of the Composition of the LCC
Fig. 6: The (In)Visibility of the Total Costs
Fig. 7: The Proportions of the Elements of the LCC
Considerations about R&D Methods, Costs and Assurance
Fig. 8: Elementary Cycle of Project Validation and Assurance
Fig. 9: The Impact on Costs Due to Method Change
Fig. 10: The Impact of Changes of |Method on Costs
Fig. 11: The Balance of Factors of Cost-Effectiveness
Fig. 12: The Factors of Effectiveness and the Costs of the Systems
APPENDICES
References
EThICS Engineering - Services and Areas of Action
You want to learn how to rank your equipment based on criticality then this chapter from the "Rules of Thumb for Maintenance and Reliability Engineers Handbook.
This document will describe the structured evaluation methodology used to “Identify Critical Equipment”. Criticality Analysis identifies the assets which contribute the most asset reliability, throughput, safety, etc. Without an effective criticality analysis an organization lacks focus on what assets contribute the most to their business.
If you have questions about asset criticality analysis send an email to Ricky Smith at askrickysmith@gmail,com
Introduction to Reliability Centered MaintenanceDibyendu De
Introduces Reliability Centered Maintenance, strategies employed, formulation of effective maintenance plan, reduction of consequences of failures and failure rate.
Is Reliability Centered Maintenance (RCM) right for you?Nancy Regan
This presentation outlines the goals of a Reliability Centered Maintenance (RCM) analysis. It debunks the top misconceptions about RCM. And it poses and answers the top four questions about RCM most people don’t know to ask.
John Day developed a proactive maintenance process in 1978 and manage maintenance and engineering at Alumax Mt. Holly and later at Alcoa Mt Holly for over 20 years. These are the slides he presented at the 1997 SMRP Conference. Great slides with great information. If you would like the slides and not PDF send me an email at rsmith@maintenancebestpractices.com. I worked for John Day back in the early 1980s which started my journey in Proactive Maintenance.
Module: EThICS 039.BC02E.07_LCPP_Conc & Princ_LCC & Effectiv
Topic: LIFE CYCLE OF PROJECTS AND PRODUCTS
Subject: Concepts and Principles of Life Cycle Cost (LCC) and Effectiveness
Scope:
PURPOSES OF THE MODULE
INTRODUCTION
Acronyms
Motivations for LCC and Effectiveness
Standards for LCC
BASIC CONCEPTS OF LCC
Elements of Life Cycle:
Life Cycle
Fig. 1: Model of Life Cycle of Projects and Products
Fig. 2: Initial Steps of RDI of Systems and Products
Acronyms of RDI
Elements of Life Cycle Cost:
Cost Driver
Cost Profile
CBS – Cost Breakdown Structure
Recurrent Costs
Non-Recurrent Costs
Fig. 3: Elements of Life Cycle Costs
LCC – Life Cycle Cost
Life Cycle Costing
TLC - Through-Life Cost
WLC - Whole-Life Cost
WLCC - Whole-Life Cycle Costing
TCO – Total Cost of Ownership
TCA – Total Cost of Acquisition
COO – Total Cost Of Operations
LAC - Life Acquisition Cost
LOC - Life Ownership Cost
LLC - Life Loss Cost
LCCA – Life Cycle Cost Analysis
CONCEPTS OF EFFECTIVENESS
Elements of Effectiveness
Effectiveness Analysis
System Effectiveness
Fig. 4: FOM - Factors Of Merit
MOE - Measure Of Effectiveness
Operational Effectiveness
Elements of Operational Effectiveness
Operational Suitability
MOS - Measure Of Suitability
Operational Availability
Operational Utility
Cost Effectiveness
CONCEPTS OF PERFORMANCE
Elements of Performance
Performance
System Performance
Level of Performance
Categories of Performance
Objective Performance
Subjective Performance
System Attributes
Attributes of Operational Performance
Physical Attributes
Functional Attributes
MOP - Measures Of Performance
MODELS OF LCC
Fig. 5: Summary Vision of Total Costs of the Life Cycle
Model of the Composition of the LCC
Fig. 6: The (In)Visibility of the Total Costs
Fig. 7: The Proportions of the Elements of the LCC
Considerations about R&D Methods, Costs and Assurance
Fig. 8: Elementary Cycle of Project Validation and Assurance
Fig. 9: The Impact on Costs Due to Method Change
Fig. 10: The Impact of Changes of |Method on Costs
Fig. 11: The Balance of Factors of Cost-Effectiveness
Fig. 12: The Factors of Effectiveness and the Costs of the Systems
APPENDICES
References
EThICS Engineering - Services and Areas of Action
You want to learn how to rank your equipment based on criticality then this chapter from the "Rules of Thumb for Maintenance and Reliability Engineers Handbook.
This document will describe the structured evaluation methodology used to “Identify Critical Equipment”. Criticality Analysis identifies the assets which contribute the most asset reliability, throughput, safety, etc. Without an effective criticality analysis an organization lacks focus on what assets contribute the most to their business.
If you have questions about asset criticality analysis send an email to Ricky Smith at askrickysmith@gmail,com
Introduction to Reliability Centered MaintenanceDibyendu De
Introduces Reliability Centered Maintenance, strategies employed, formulation of effective maintenance plan, reduction of consequences of failures and failure rate.
Reliability Centered Maintenance II (RCM2) in Water and Wastewater Utilities ...marcus evans Network
George Terry, Ontario Clean Water Agency - Speaker at the marcus evans Water & Wastewater Management Summit 2012, held in Summerlin, NV, May 3-4, 2012, delivered his presentation entitled Reliability Centered Maintenance II (RCM2) in Water and Wastewater Utilities
The Integrated Master Plan and Integrated Master Schedule are homes for the Measures of Effectiveness (MOE), Measures of Performance (MOP), and Technical Performance Measures (TPM) for the program
Each measure is derived from the Systems Engineering processes guided by the Systems Engineering Management Plan (SEMP) and the decomposition of the program's technical architecture.
INCOSE Systems Engineering Handbook and ISO 15288 provide the framework for this decomposition.
This is a three parts lecture series. The parts will cover the basics and fundamentals of reliability engineering. Part 1 begins with introduction of reliability definition and other reliability characteristics and measurements. It will be followed by reliability calculation, estimation of failure rates and understanding of the implications of failure rates on system maintenance and replacements in Part 2. Then Part 3 will cover the most important and practical failure time distributions and how to obtain the parameters of the distributions and interpretations of these parameters. Hands-on computations of the failure rates and the estimation of the failure time distribution parameters will be conducted using standard Microsoft Excel.
Part 1. Reliability Definitions
1.Reliability---Time dependent characteristic
2.Failure rate
3.Mean Time to Failure
4.Availability
5.Mean residual life
Honeywell’s UniSim® Operations is part of the comprehensive UniSim Competency Suite, which helps better train today’s industrial workforce. This solution can be used to replicate and assess the operational readiness of plant assets long before they are applied in real-world production scenarios.
TPM For lean manufacturing chp3 | kobetsu kaizen for production efficiency...博行 門眞
My Home page is Japanese Gemba Kaizen Web
http://takuminotie.com/english/
Please Look and Like us on Facebook
Table of contents
1. Improvement of zero failure
2. Improvement of the setup
3. Improvement of cutting blade change loss
4. Improvement of start up
5. Improvement of Minor stoppage
6.Improvement of Speed losses
7.Improvement of Yield losses
8. Principle of improvement
Legal Aspects of FMEA, overview of Canadian Law,
Due Diligence vs Negligence, Criminal Negligenced and what everyone needs to know about duty of care
www.6sengineering.com
Binseng Wang, ScD, CCE – Vice President, Performance Management & Regulatory Compliance, ARAMARK Healthcare’s Clinical Technology Services
Clinical engineering (CE) professionals have realized for some time that the “preventive maintenance” (PM) that they have been performing for many years is no longer able to prevent any failures, although some safety and performance inspections (SPIs) can help detect hidden and potential failures that affect patient safety. To help CE professionals decide whether they should continue to perform scheduled maintenance (SM) or not, a systematic method for determining maintenance effectiveness has been developed. This method uses a small set of codes to classify failures found during repairs and SM (PMs and SPIs). Analysis of the failure patterns and their effects on patients and users allows CE professionals to compare the effectiveness of different maintenance strategies, and justify changes in strategies, such as decreasing SM, deploying statistical sampling, or even eliminating SM.
TPM the effective maintenance with Autonomous MaintenanceTimothy Wooi
This is a 2 days course on Total Productive Maintenance (TPM) that will guide you through to implement Autonomous Maintenance (AM) on your current Equipment and to plan the execution of your Preventive (PM) & Predictive Maintenance (PdM).TPM defines your Maintenance schedule and Goals. TPM helps you plan and develop the optimal program for your facility, resulting in increased efficiency and cost savings.
Day 1
TPM General Overview with Autonomous
Maintenance (AM) as the back bone of TPM
6 Steps to Autonomous Maintenance
Audit , Review & Externalize Inspection Activities
from Equipment Manual to (AM)
Executing Equipment Audit to start (AM) & (PM)
-TPM Board & AM Checklist with Visual
Management Implementation.
Reliability Centered Maintenance II (RCM2) in Water and Wastewater Utilities ...marcus evans Network
George Terry, Ontario Clean Water Agency - Speaker at the marcus evans Water & Wastewater Management Summit 2012, held in Summerlin, NV, May 3-4, 2012, delivered his presentation entitled Reliability Centered Maintenance II (RCM2) in Water and Wastewater Utilities
The Integrated Master Plan and Integrated Master Schedule are homes for the Measures of Effectiveness (MOE), Measures of Performance (MOP), and Technical Performance Measures (TPM) for the program
Each measure is derived from the Systems Engineering processes guided by the Systems Engineering Management Plan (SEMP) and the decomposition of the program's technical architecture.
INCOSE Systems Engineering Handbook and ISO 15288 provide the framework for this decomposition.
This is a three parts lecture series. The parts will cover the basics and fundamentals of reliability engineering. Part 1 begins with introduction of reliability definition and other reliability characteristics and measurements. It will be followed by reliability calculation, estimation of failure rates and understanding of the implications of failure rates on system maintenance and replacements in Part 2. Then Part 3 will cover the most important and practical failure time distributions and how to obtain the parameters of the distributions and interpretations of these parameters. Hands-on computations of the failure rates and the estimation of the failure time distribution parameters will be conducted using standard Microsoft Excel.
Part 1. Reliability Definitions
1.Reliability---Time dependent characteristic
2.Failure rate
3.Mean Time to Failure
4.Availability
5.Mean residual life
Honeywell’s UniSim® Operations is part of the comprehensive UniSim Competency Suite, which helps better train today’s industrial workforce. This solution can be used to replicate and assess the operational readiness of plant assets long before they are applied in real-world production scenarios.
TPM For lean manufacturing chp3 | kobetsu kaizen for production efficiency...博行 門眞
My Home page is Japanese Gemba Kaizen Web
http://takuminotie.com/english/
Please Look and Like us on Facebook
Table of contents
1. Improvement of zero failure
2. Improvement of the setup
3. Improvement of cutting blade change loss
4. Improvement of start up
5. Improvement of Minor stoppage
6.Improvement of Speed losses
7.Improvement of Yield losses
8. Principle of improvement
Legal Aspects of FMEA, overview of Canadian Law,
Due Diligence vs Negligence, Criminal Negligenced and what everyone needs to know about duty of care
www.6sengineering.com
Binseng Wang, ScD, CCE – Vice President, Performance Management & Regulatory Compliance, ARAMARK Healthcare’s Clinical Technology Services
Clinical engineering (CE) professionals have realized for some time that the “preventive maintenance” (PM) that they have been performing for many years is no longer able to prevent any failures, although some safety and performance inspections (SPIs) can help detect hidden and potential failures that affect patient safety. To help CE professionals decide whether they should continue to perform scheduled maintenance (SM) or not, a systematic method for determining maintenance effectiveness has been developed. This method uses a small set of codes to classify failures found during repairs and SM (PMs and SPIs). Analysis of the failure patterns and their effects on patients and users allows CE professionals to compare the effectiveness of different maintenance strategies, and justify changes in strategies, such as decreasing SM, deploying statistical sampling, or even eliminating SM.
TPM the effective maintenance with Autonomous MaintenanceTimothy Wooi
This is a 2 days course on Total Productive Maintenance (TPM) that will guide you through to implement Autonomous Maintenance (AM) on your current Equipment and to plan the execution of your Preventive (PM) & Predictive Maintenance (PdM).TPM defines your Maintenance schedule and Goals. TPM helps you plan and develop the optimal program for your facility, resulting in increased efficiency and cost savings.
Day 1
TPM General Overview with Autonomous
Maintenance (AM) as the back bone of TPM
6 Steps to Autonomous Maintenance
Audit , Review & Externalize Inspection Activities
from Equipment Manual to (AM)
Executing Equipment Audit to start (AM) & (PM)
-TPM Board & AM Checklist with Visual
Management Implementation.
To achieve success in any project domains, measures of progress to plan are needed in units meaningful to the decision-makers. These include cost, schedule, and technical performance
APM is a holistic approach used to ensure that the business of caring for corporation’s maintainable assets is done in the most cost-effective manner to promote asset longevity, performance and capability.
It cultivates a partnership between operations and maintenance, whose common goal is equipment uptime.
APM optimize the equipment performance and reliability on daily basis.
It will help to identify the current asset health and able to provide a long term view to drive capital planning.
Visibility into complete lifecycle of asset – Understanding the Economic Value Add
Aligning asset performance to corporate performance
An effective APM process involves the development and implementation of reliability programs for operational assets coupled with application of ongoing performance monitoring and improvement to drive program optimization overtime.
Recent College of Performance Management Webinar on using Technical Performance to inform Earned Value Management. Six steps to building a credible Performance Measurement Baseline to connect the dots between all the elements of the program
Boeing e-enabled Advantage case study and recommendations by Adheesha Dharmakeerthi, Chamith De Costa, Shyamen De Silva, Nishani Fernando, R. Pirasanth, Iresha Karunasena , Rochelle Benedict, Group B2 of Postgraduate Institute of Management(PIM) - MBA 2019 batch
Planning projects usually starts with tasks and milestones. The planner gathers this information from the participants – customers, engineers, subject matter experts. This information is usually arranged in the form of activities and milestones. PMBOK defines “project time management” in this manner. The activities are then sequenced according to the projects needs and mandatory dependencies.
Increasing the Probability of Project SuccessGlen Alleman
Risk Management is essential for development and production programs. Information about key cost, performance and schedule attributes are often uncertain or unknown until late in the program.
Risk issues that can be identified early in the program, which may potentially impact the program, termed Known Unknowns, can be alleviated with good risk management. -- Effective Risk Management 2nd Edition, Page 1, Edmund Conrow, American Institute of Aeronautics and Astronautics, 2003
Cost and schedule growth for complex projects is created when unrealistic technical performance expectations, unrealistic cost and schedule estimates, inadequate risk assessments, unanticipated technical issues, and poorly performed and ineffective risk management, contribute to project technical and programmatic shortfalls
From Principles to Strategies for Systems EngineeringGlen Alleman
From Principles to Strategies How to apply Principles, Practices, and Processes of Systems Engineering to solve complex technical, operational,
and organizational problems
Building a Credible Performance Measurement BaselineGlen Alleman
Establishing a credible Performance Measurement Baseline, with a risk adjusted Integrated Master Plan and Integrated Master Schedule, starts with the WBS and connects Technical Measures of progress to Earned Value
Capabilities‒Based Planning the capabilities needed to accomplish a mission or fulfill a business strategy
Only when capabilities are defined can we start with requirements elicitation
Starting with the development of a Rough Order of Magnitude (ROM) estimate of work and duration, creating the Product Roadmap and Release Plan, the Product and Sprint Backlogs, executing and statusing the Sprint, and informing the Earned Value Management Systems, using Physical Percent Complete of progress to plan.
Program Management Office Lean Software Development and Six SigmaGlen Alleman
Successfully combining a PMO, Agile, and Lean / 6 starts with understanding what benefit each paradigm brings to the table. Architecting a solution for the enterprise requires assembling a “Systems” with processes, people, and principles – all sharing the goal of business improvement.
This resource document describes the Program Governance Road map for product development, deployment, and sustainment of products and services in compliance with CMS guidance, ITIL IT management, CMMI best practices, and other guidance to assure high quality software is deployed for sustained operational success in mission critical domains.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Enhancing Performance with Globus and the Science DMZGlobus
ESnet has led the way in helping national facilities—and many other institutions in the research community—configure Science DMZs and troubleshoot network issues to maximize data transfer performance. In this talk we will present a summary of approaches and tips for getting the most out of your network infrastructure using Globus Connect Server.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Technical Performance Measures
1. CPM–500 EVM/SE/TPM Integration
CPM–500–B/C/F : Integrating Systems
Engineering with Earned Value Management
Lesson 3 CPM–500F: Technical Performance Measures
Glen B. Alleman
Lewis & Fowler
galleman@lewisandfowler.com
(303) 241 9633
June 2010
Naples, Florida
Professional Education Program (Training Track) presented by
PMI–College of Performance Management faculty
Rights Reserved 1/63
2. CPM–500 EVM/SE/TPM Integration
The Purpose Of This Series
This is the last “connected” lesson in a 3–part series that explores the
integration of System Engineering (SE) and Earned Value Management
(EVM).
You don’t need to attend all three lessons – but it helps in Connecting
The Dots
Why have this series?
– Often, project control specialists see the planning of the cost and
schedule baselines as an isolated activity disconnected from the technical
or engineering aspects.
– This type of thinking significantly impacts development of the baseline
which results in poor maintenance and eventual irrelevance of the
baseline
– We claim “victory” if after any one of these lessons, you can recognize the
importance of integrating these disciplines such that he/she will advocate
greater cooperation between the engineering and project control
elements of his/her respective organization
Rights Reserved 2/63
3. CPM–500 EVM/SE/TPM Integration
Lesson 3 Objectives
In this lesson we will:
Understand how to establish credibility for
Technical Performance Measures by using Earned
Value and Systems Engineering to measure
progress
Establish the processes of defining and measuring
technical performance
Establish the role of the technical baseline in
program management
Learn how TPM’s are integrated into planning and
execution at the control account level through
examples and a hands on exercise
Rights Reserved 3/63
4. CPM–500 EVM/SE/TPM Integration
Can Earned Value Alone Get Us
To Our Destination?
How do we increase visibility into the program’s performance?
How do we reduce cycle time to deliver the product?
How do we foster accountability?
How do we reduce risk?
How do we start this journey to success?
Increasing the Probability of Success means we have to
Connect The Dots to Reach Our Destination
Rights Reserved 4/63
6. CPM–500 EVM/SE/TPM Integration
Learnings from Lesson 1 and 2
How cost and schedule (EV) are
connected to the Performance
Measurement Baseline
Rights Reserved 6/63
7. CPM–500 EVM/SE/TPM Integration
Increasing the Probability of
Program Success Means …
Building A Credible Performance Measurement Baseline
Risk Cost
IMP/IMS PMB SOW
WBS TPM
This is actually harder than it looks!
Rights Reserved 7/63
8. CPM–500 EVM/SE/TPM Integration
Doing This Starts With Some Guidance
Systems engineering uses technical performance
measurements to balance cost, schedule, and
performance throughout the life cycle. Technical
performance measurements compare actual versus
planned technical development and design. They
also report the degree to which system requirements
are met in terms of performance, cost, schedule, and
progress in implementing risk handling. Performance
metrics are traceable to user–defined capabilities.
― Defense Acquisition Guide
(https://dag.dau.mil/Pages/Default.aspx)
In The End ― It’s All About Systems Engineering
Rights Reserved 8/63
9. CPM–500 EVM/SE/TPM Integration
Guidance for Measures of
Effectiveness, Performance, and
Technical Performance
Our starting point is not EVM, it’s Systems Engineering
MOE’s are an essential part of Systems Engineering,
guided by IEEE 1220 and EIA 632.
System’s Engineers drive the content of all
measurement items, customer or supplier.
Rights Reserved 9/63
10. CPM–500 EVM/SE/TPM Integration
Just A Reminder Of The …
Primary Elements of Earned Value
Cost
Funding margin Schedule margin for
for under Over cost or Over cost or over target baseline
performance under over (OTB)
performance schedule
Over
Technical schedule or
Performance under Schedule
performing
Schedule margin for
underperformance or
schedule extension
Rights Reserved 10/63
11. CPM–500 EVM/SE/TPM Integration
Previous Approaches Using EV
Are Mostly Unsuccessful In
Connecting These
Traditional approaches to program management
are retrospective
– Cost and schedule of Earned Value
– Risk Management
– Systems Engineering
Reporting past performance
– Sometimes 30 to 60 days old
– Variances are reporting beyond the widow of
opportunity for correction
Rights Reserved 11/63
12. CPM–500 EVM/SE/TPM Integration
It’s All Been Said Before.
We Just Weren’t Listening…
… the basic tenets of the process are the need for
seamless management tools, that support an integrated
approach … and “proactive identification and
management of risk” for critical cost, schedule, and
technical performance parameters.
― Secretary of Defense, Perry memo, May 1995
Why Is This Hard To Understand?
We seem to be focused on EV reporting, not the use
of EV to manage the program.
Getting the CPR out the door is the end of Program
Planning and Control’s efforts, not the beginning.
Rights Reserved 12/63
13. CPM–500 EVM/SE/TPM Integration
The Gap Seems To Start With A
Common Problem
Many Times, The Information from Cost, Schedule, Techncial
Performance, and Risk Management Gets Mixed Up When We
Try to Put Them Together
Rights Reserved 13/63
14. CPM–500 EVM/SE/TPM Integration
When We Put The Cart Before
The Horse, We Discover …
EVM really doesn’t do its job effectively
Most of the time EV has no measure of quality
or compliance with technical requirements.
EV measures progress to plan in units of
“money,” not tangible value to the customer
Most EV System Descriptions fail to connect the
dots between cost, schedule, and technical
performance – even though instructed to do so
in the official guidance
Rights Reserved 14/63
15. CPM–500 EVM/SE/TPM Integration
The NDIA EVM Intent Guide Says
Notice the inclusion of Technical along with
Cost and Schedule
That’s the next step is generating Value from Earned Value
EV MUST include the Technical Performance Measures
Rights Reserved
16. CPM–500 EVM/SE/TPM Integration
Back To Our Technical
Performance Measures
Technical Performance Measures do what
they say,
Measure the Technical Performance
of the product or service produced by the
program
Rights Reserved 16/63
17. CPM–500 EVM/SE/TPM Integration
What’s Our Motivation for
“Connecting the Dots?”
TPMs are a set of measures that provide the supplier and
acquirer with insight into progress to plan of the technical
solution, the associated risks, and emerging issues.
Technical Performance Measures …
Provide program management with information
to make better decisions
Increase the probability of delivering a solution
that meets both the requirements and mission
need
We’ve been talking about this since as early as 1984, in Technical Performance
Measurement Handbook, Defense Systems Management College, Fort Belvoir, VA 22060
Rights Reserved 17/63
18. CPM–500 EVM/SE/TPM Integration
Measure of Effectiveness (MoE)
The operational measures of success that are closely
related to the achievements of the mission or operational
objectives evaluated in the operational environment,
under a specific set of condition
Measures of Effectiveness …
Are stated by the buyer in units meaningful to
the buyer
Focus on capabilities independent of any
technical implementation
MoE Belong to the End User
“Technical Measurement,” INCOSE–TP–2003–020–01 Rights Reserved 18/63
19. CPM–500 EVM/SE/TPM Integration
Measure of Performance (MoP)
Measures that characterize physical or functional
attributes relating to the system operation, measured or
estimated under specific conditions
Measures of Performance are …
Attributes that assure the system has the
capability to perform
Assessment of system to assure it meets design
requirements necessary to satisfy the MOE
MoP’s belong to the Program – Developed by the Systems
Engineer, Measured By CAMs, and Analyzed by PP&C
“Technical Measurement,” INCOSE–TP–2003–020–01 Rights Reserved 19/63
20. CPM–500 EVM/SE/TPM Integration
Key Performance Parameters (KPP)
Represent the capabilities and characteristics so
significant that failure to meet them can be cause for
reevaluation, reassessing, or termination of the program
Key Performance Parameters …
have a threshold or objective value
Characterize the major drivers of performance
Are considered Critical to Customer (CTC)
The acquired defines the KPPs during the operational
concept development – KPPs say what DONE looks like
“Technical Measurement,” INCOSE–TP–2003–020–01 Rights Reserved 20/63
21. CPM–500 EVM/SE/TPM Integration
Technical Performance Measures (TPM)
Attributes that determine how well a system or system
element is satisfying or expected to satisfy a technical
requirement or goal
Technical Performance Measures …
Assess design progress
Define compliance to performance requirements
Indentify technical risk
Are limited to critical thresholds
Include projected performance
“Technical Measurement,” INCOSE–TP–2003–020–01 Rights Reserved 21/63
22. CPM–500 EVM/SE/TPM Integration
Dependencies Between Measures
Stakeholders Define Needs and Capabilities Suppliers Define Physical Solutions that
in terms of Operational Scenarios meet the needs of the Stakeholders
KPP
Mission
MoE MoP TPM
Need
Operational Measures that Measures used to
measures of characterize assess design
success related to physical or progress,
the achievement functional compliance to
of the mission or attributes relating performance
operational to the system requirements, and
objective being operation technical risks
evaluated.
“Coming to Grips with Measures of Effectiveness,” N. Sproles,
Systems Engineering, Volume 3, Number 1, pp. 50–58
Rights Reserved 22/63
23. CPM–500 EVM/SE/TPM Integration
“Candidates” for Technical Measures
Concept Description
Useful Life
Physical Size and Stability Weight
Volumetric capacity
Accuracy
Functional Correctness
Power performance
Supportability
Maintainability
All the “ilities”
Dependability
Reliability
Reliability = Mean Time Failure
Utilization
Efficiency Response time
Throughput
Suitability for Purpose Readiness
Rights Reserved 23/63
INCOSE Systems Engineering Handbook
24. CPM–500 EVM/SE/TPM Integration
“Measures” of Technical Measures
Attribute Description
Measured technical progress or estimate of
Achieved to Date
progress
Value of a technical parameter that is predicted to
Current Estimate
be achieved
Point in time when an evaluation of a measure is
Milestone
accomplished
Planned Value Predicted value of the technical parameter
Planned Performance Profile representing the project time phased
Profile demonstration of a technical parameter
Tolerance Band Management alert limits
Threshold Limiting acceptable value of a technical parameter
Demonstrated technical variance
Variances
INCOSE Systems Engineering Handbook Predicted technical variance
Rights Reserved 24/63
25. CPM–500 EVM/SE/TPM Integration
A Familiar Graphic of TPMs
TPM
Upper Limit
Planned Profile
Current Estimate
Planned Value
Mean To Between Failure
Threshold
Variance Lower Limit
Achieved to Date
Milestones
Time = Program Maturity
Rights Reserved 25/63
26. CPM–500 EVM/SE/TPM Integration
A Simple Method of Assembling the TPMs
MOE / MOP KPP / TPM Risks
Define the Assess the
Select Technical
planned impact on Risk
Performance
progress for from this
Parameters
each TPM progress
Parameters Progress Risk
Weight XXXX
Speed XXXX
MTBF XXXX
Loiter Time XXXX
Rights Reserved 26/63
29. CPM–500 EVM/SE/TPM Integration
What Does A Real Technical
Performance Measure Look Like?
Not that bagels are not
interesting in Lesson 1 and
2, but let’s get ready to look
at a flying machine.
Rights Reserved 29/63
30. CPM–500 EVM/SE/TPM Integration
The WBS for a UAV TPMs Start With The WBS
1.1 Air Vehicle
1.1.1 Sensor Platform
1.1.2
1.1.2 Airframe
Airframe
1.1.3 Propulsion
1.1.4 On Board Comm
1.1.5 Auxiliary Equipment
1.1.6 Survivability
Modules
1.1.7 Electronic Warfare
Module
1.1.8 On Board
Application &
System SW
1.3 Mission Control /
Ground Station SW
1.3.1 Signal Processing
SW
1.3.2 Station Display
1.3.3 Operating System
1.3.4 ROE Simulations
1.3.5 Mission Commands
Rights Reserved 30/63
31. CPM–500 EVM/SE/TPM Integration
What Do We Need To Know About
This Program Through TPMs
What WBS elements represent the TPMs?
What Work Packages produce these WBS
elements?
Where do these Work Packages live in the IMS?
What are the Earned Value baseline values for
these Work Packages?
How are going to measure all these variables?
What does the curve look like for these
measurements?
Rights Reserved 31/63
32. CPM–500 EVM/SE/TPM Integration
Let’s Connect The Dots
Technical and Programmatic
Risks Connected to the WBS
and IMS BCWS at the Work
Package, rolled to the
Control Account
IMS contains all
the Work
Packages, BCWS, Risk Cost
Risk mitigation Named
plans, and rolls to IMP/IMS PMB SOW Deliverables
the Integrated defined in the WBS
Master Plan to WBS TPM
measure
increasing maturity TPMs attached to each
critical deliverables in the
WBS and identified in
The Products and each Work Package in the
Processes that produce IMS, used to assess
them in a “well structured” maturity in the IMP
decomposition in the WBS
Rights Reserved 32/63
33. CPM–500 EVM/SE/TPM Integration
Verifying Each TPM
Evidence that we’re in compliance
With our submitted ROM what are the values we need to get
Do we know what we promised to
CA through Integrated Baseline Review «how do we measure
deliver, now that we’ve won?
weight for each program event»
The contributors to the vehicle weight are confirmed and the
Can we proceed into preliminary
SFR upper limits defined in the product architecture and
design?
requirements flow down database (DOORS) into a model
Can we proceed into the System Do we know all drivers of vehicle weight? Can we bound their
SRR Development and Demonstration upper limits? Can the subsystem owners be successful within
(SDD) phase these constraints uses a high fidelity model?
Can we start detailed design, and Does each subsystem designer have the target component
meet the stated performance weight target and have some confidence they can stay below
PDR requirements the upper bound? Can this be verified in some tangible way?
within cost, schedule, Either through prior examples or a lab model?
risk, and other constraints?
Can the system proceed to Do we know all we need to know to start the fabrication of
fabrication, demonstration, and test, the first articles of the flight vehicle. Some type of example,
CDR
with the within cost, schedule, risk, maybe a prototype is used to verify we’re inside the lines
and other system constraints.
Can the system ready to Does the assembled vehicle fall within the weight range limits
TRR Rights Reserved
proceed into formal test? for 1st flight – will this thing get off the ground? 33/63
34. CPM–500 EVM/SE/TPM Integration
TPM Trends & Responses
Design Model
ROM in Proposal Detailed Design Model
Bench Scale Model Measurement
Technical Performance Measure
28kg Prototype Measurement
Vehicle Weight
Flight 1st Article
26kg
25kg
23kg
CA SFR SRR PDR CDR TRR
EV Taken, planned values met, tolerances kept, etc.
Rights Reserved Dr. Falk Chart – modified 34/63
35. CPM–500 EVM/SE/TPM Integration
The Assessment Of Weight As A
Function Of Time
At Contract Award there is a Proposal grade estimate of
vehicle weight
At System Functional Review, the Concept of
Operations is validated for the weight
At System Requirements Review the weight targets are
flowed down to the subsystems components
At PDR the CAD model starts the verification process
At CDR actual measurements are needed to verify all
models
At Test Readiness Review we need to know how much
fuel to put on board for the 1st flight test
Rights Reserved 35/63
36. CPM–500 EVM/SE/TPM Integration
The WBS for a UAV Airframe Weight TPM
1.1 Air Vehicle The planned weight is
1.1.1 Sensor Platform 25kg. The actual weight is
1.1.2 Airframe 25.5kg.
1.1.2 Airframe
Close to plan! So we are
doing okay, right?
CA SFR SRR PDR CDR TRR
Planned Value 28.0kg 27.0kg 26.0kg 25.0kg 24.0kg 23.0kg
Actual Value 30.4kg 29.0kg 27.5kg 25.5kg
Moderate Low Low Very Low (less
Assessed Risk
>2.0kg off 1–2 kg off 1–2 kg off than 1.0 kg
to TRR
target target target off target)
Program– Actual Actual
Program–
Planned “Similar to” unique design measurement measurement
ROM unique design
Method Estimate model with of bench–test of prototype
model
validated data components airframe
Actual “Similar to”
Method Estimate
ROM ROM ROM Here’s the Problem
Rights Reserved 36/63
37. CPM–500 EVM/SE/TPM Integration
Is This A Problem?
You Bet’ya It’s A Problem!
The measurement is close to the planned value,
But the planned method of measurement is a
program unique design model with validated
data,
But the actual method of measurement is a
rough order of magnitude estimate,
No improvement in fidelity since the System
Functionality Review (SFR), and
The TPM provides no new information – so
we’re probably late and don’t know it yet.
Rights Reserved 37/63
38. CPM–500 EVM/SE/TPM Integration
Raison d'etre for Technical
Performance Measures
The real purpose of
Risk Cost
Technical Performance
Measures is to reduce IMP/IMS PMB SOW
Programmatic and WBS TPM
Technical RISK
Rights Reserved 38/63
39. CPM–500 EVM/SE/TPM Integration
Buying Down Risk with TPMs
Risk: CEV-037 - Loss of Critical Functions During Descent
“Buying down” risk is
24
22
20
Correlate the analytical model
Conduct focus splinter review
Develop analytical model to de
planned in the IMS.
MoE, MoP, and KPP
Conduct Force and Moment Wind
18
Conduct Block 1 w ind tunnel te
16 Conduct w ind tunnel testing of
Conduct w ind tunnel testing of
defined in the work
14
Flight Application of Spacecra
12
package for the critical
10 CEV block 5 w ind tunnel testin
8
6
4
2
In-Flight development tests of
Damaged TPS flight test
measure – weight.
If we can’t verify
0
3.Jul.06
1.Jul.11
31.Mar.05
5.Oct.05
1.Jun.07
1.Jan.10
16.Dec.10
15.Sep.06
3.Apr.06
1.Apr.08
1.Aug.08
1.Apr.09
Planned Risk Level
Weight risk
reduced from
Planned (Solid=Linked, Hollow =Unlinked, Filled=Complete)
Weight confirmed
ready to fly – it’s
we’ve succeeded, then
RED to Yellow GREEN at this point
the risk did not get
reduced.
The risk may have
gotten worse.
Rights Reserved 39/63
40. CPM–500 EVM/SE/TPM Integration
Increasing the Probability of
Success with Risk Management
Going outside the TPM
limits always means
cost and schedule
impacts
“Coloring Inside the
Lines” means knowing
the how to keep the
program GREEN, or at
least stay close to So much for our strategy of winning
GREEN through technical dominance
Rights Reserved 40/63
41. CPM–500 EVM/SE/TPM Integration
Connecting the EV Variables
Integrating Cost, Schedulele, and Technical Performance
Assures Program Management has the needed performance information to deliver
on‒time, on‒budget, and on‒specification
=
Technical Performance Measures
Cost + Schedule
Conventional Earned Value
Cost Baseline Technical Performance Schedule Baseline
Master Schedule used to Earned Value is diluted Requirements are
derive Basis of Estimate by missing technical decomposed into
(BOE) not the other way performance. physical deliverables.
around. Earned Value is diluted Deliverables are
Probabilistic cost by postponed features. produced through Work
estimating uses past Earned Value is diluted Packages.
performance and cost by non compliant quality. Work Packages are
risk modeling. All these dilutions assigned to accountable
Labor, Materiel, and require adjustments to manager.
other direct costs the Estimate at Complete Work Packages are
accounted for in Work (EAC) and the To sequenced to form the
Packages Complete Performance highest value stream
Risk adjustments for all Index (TCPI). with the lowest technical
elements of cost. Rights Reserved
and programmatic risk.
41/63
42. CPM–500 EVM/SE/TPM Integration
TPM Checklist
MoE MoP TPM
Traceable to needs, Traceable to applicable Traceable to applicable MoPs,
goals, objectives, and MOEs, KPPs, system level system element performance,
risks performance requirements, requirements, objectives,
and risks risks, and WBS elements
Defined with associated Focused on technical risks Further decomposed,
KPPs and supports trades budgeted, and allocated to
between alternative lower level system elements in
solutions the WBS and IMS
Each MoE independent Provided insight into Assigned an owner, the CAM
from others system performance and Work Package Manager
Each MoE independent Decomposed, budgeted Sources of measure identified
of technical any solution and allocated to system and processes for generating
elements the measures defined.
Address the required Assigned an “owner,” the Integrated into the program’s
KPPs CAM and Technical IMS as part of the exit criteria
Manager Rights Reserved for the Work Package 42/63
43. CPM–500 EVM/SE/TPM Integration
Increasing the Probability of
Program Success Means …
Building A Credible Performance Measurement Baseline
Risk Cost
IMP/IMS PMB SOW
WBS TPM
Using the Check List – “Connect the Dots”
Rights Reserved 43/63
45. CPM–500 EVM/SE/TPM Integration
Backup Materials
Knowledge is of two kinds. We know a
subject ourselves, or we know where
we can find information on it
— Samuel Johnson
Rights Reserved 45/63
46. CPM–500 EVM/SE/TPM Integration
Many of Sources for Connecting the Dots
OMB Circular A–11, Section 300 Interim Defense Acquisition Guidebook (DAG)
6/15/09
GAO Report 06–250 Systems Engineering Plan (SEP) Preparation Guide
4/08
DoDI 5000.02, Operation of the Defense WBS Handbook, Mil–HDBK–881A (WBS) 7/30/05
Acquisition System (POL) 12/08
Integrated Master Plan (IMP) & Integrated Guide for Integrating SE into DOD Acquisition
Master Schedule Preparation & Use Guide Contracts 12/06
(IMS) 10/21/05
Defense Acquisition Program Support Guide to the Project Management Institute Body of
Methodology (DAPS) V2.0 3/20/09 Knowledge (PMBOK Guide®), 4th Edition
Standard for Application and Capability Maturity Model Integration (CMMI®)
Management of the SE Process (IEEE
1220)
IEEE 1220: 6.8.1.5 Processes for Engineering a System (ANSI/EIA–632)
NASA EVM Guide NPG 9501.3
Rights Reserved 46/63
47. CPM–500 EVM/SE/TPM Integration
Office of Management and
Budget
Circular No. A–11, Section 300
Planning, Budgeting, Acquisition and Management
of Capital Assets
Section 300–5
– Performance–based acquisition management
– Based on EVMS standard
– Measure progress towards milestones
• Cost
• Capability to meet specified requirements
• Timeliness
• Quality
Rights Reserved 47/63
48. CPM–500 EVM/SE/TPM Integration
Need: Accurate Performance
Measurement
Findings and
GAO Report 06–250 Recommendations
Information Technology: 2. If EVM is not
Improve the Accuracy and implemented effectively,
Reliability of Investment decisions based on
Information inaccurate and potentially
misleading information
3. Agencies not measuring
actual versus expected
performance in meeting
IT performance goals.
Rights Reserved 48/63
49. CPM–500 EVM/SE/TPM Integration
DOD Guides:
Technical Performance
Department of Defense Guidelines for Technical Performance Measures
DoDI 5000.02, Operation of the Defense Acquisition System (POL) 12/08
Interim Defense Acquisition Guidebook (DAG) 6/15/09
Systems Engineering Plan (SEP) Preparation Guide 4/08
WBS Handbook, Mil–HDBK–881A (WBS) 7/30/05
Integrated Master Plan (IMP) & Integrated Master Schedule Preparation &
Use Guide (IMS) 10/21/05
Guide for Integrating SE into DOD Acquisition Contracts (Integ SE) 12/06
Defense Acquisition Program Support Methodology (DAPS) V2.0 3/20/09
Rights Reserved 49/63
50. CPM–500 EVM/SE/TPM Integration
DoD: TPMs in Technical Baselines and Reviews
Engineering
Integrated
IMP/IMS
Systems
DAPS
WBS
DAG
POL
SEP
DoD Policy or Guide
Technical Baselines:
IMP/IMS
Functional (SFR)
Allocated (PDR)
Product (CDR)
Event driven timing
Success criteria of
technical review
Entry and exit criteria
for technical reviews
Assess technical
maturity Reserved
Rights 50/63
51. CPM–500 EVM/SE/TPM Integration
DoD: TPMs in Integrated Plans
Engineering
Integrated
IMP/IMS
Systems
DAPS
WBS
DAG
POL
SEP
DoD Policy or Guide
Integrated SEP with:
IMP/IMS
TPMs
EVM
Integrated WBS with
Requirement
Specification
Statement of Work
IMP/IMS/EVMS
Link risk management,
technical reviews, TPMs,
EVM, WBS, IMS Rights Reserved 51/63
52. CPM–500 EVM/SE/TPM Integration
Guidance in Standards, Models,
and Defense Acquisition Guide
Processes for Engineering a System (ANSI/EIA–632)
Standard for Application and Management of the SE
Process (IEEE 1220)
Capability Maturity Model Integration (CMMI®)
– CMMI for Development, Version 1.2
– CMMI for Acquisition, Version 1.2
– Using CMMI to Improve Earned Value Management,
2002
Guide to the Project Management Institute Body of
Knowledge (PMBOK Guide®), 4th Edition
Rights Reserved 52/63
53. CPM–500 EVM/SE/TPM Integration
Technical Performance
Measures (TPM)
More Sources
IEEE 1220: 6.8.1.5, EIA–632: Glossary CMMI for Development
Performance–based Requirements
progress measurement Development
TPMs are key to Predict future value of key Specific Practice (SP) 3.3,
progressively assess technical parameters of Analyze Requirements
technical progress the end system based on Typical work product:
current assessments TPMs
Establish dates for Planned value profile is Subpractice:
– Checking progress time–phased achievement Identify TPMs that will be
– Meeting full projected tracked during
conformance to • Achievement to date development
requirements • Technical milestone
where TPM evaluation is
reported
Rights Reserved 53/63
54. CPM–500 EVM/SE/TPM Integration
PMBOK® Guide
10.5.1.1 Project Management Plan
Performance Measurement Baseline:
– Typically integrates scope, schedule, and cost
parameters of a project
– May also include technical and quality parameters
Rights Reserved 54/63
55. CPM–500 EVM/SE/TPM Integration
PMBOK® Guide
8.3.5.4 Work Performance Measurements
Used to produce project activity metrics
Evaluate actual progress as compared to
planned progress
Include, but are not limited to:
– Planned vs. actual technical performance
– Planned vs. actual schedule performance, and
– Planned vs. actual cost performance.
Rights Reserved 55/63
56. CPM–500 EVM/SE/TPM Integration
TPMs in DAG and DAPS
Defense Acquisition Guide
Performance measurement of WBS elements, using
objective measures:
– Essential for EVM and Technical Assessment activities
Use TPMs and Critical Technical Parameters (CTP) to
report progress in achieving milestones
DAPS
Use TPMs to determine whether % completion
metrics accurately reflect quantitative technical
progress and quality toward meeting Key
Performance Parameters (KPP) and Critical
Technical Parameters
Rights Reserved 56/63
57. CPM–500 EVM/SE/TPM Integration
TPMs in DAG
Compare the actual versus planned technical
development and design
Report progress in the degree to which system
performance requirements are met.
Plan is defined in terms of:
– Expected performance at specific points
• Defined in the WBS and IMS
– Methods of measurement at those points
– Variation limits for corrective action.
Rights Reserved 57/63
58. CPM–500 EVM/SE/TPM Integration
PMBOK® Guide
11.6.2.4 Technical Performance Measurement
Compares technical accomplishments… to … project
management plan’s schedule of technical
achievement
Requires definition of objective quantifiable
measures of technical performance which can be
used to compare actual results against targets.
Might include weight, transaction times, number of
delivered defects, storage capacity etc.
Deviation, such as demonstrating more or less
functionality than planned at a milestone…forecast
degree of success in achieving the project’s scope.
Rights Reserved 58/63
59. CPM–500 EVM/SE/TPM Integration
CMMI–ACQ
Acquisition Technical Management
SP 1.3 Conduct Technical Reviews
Typical supplier deliverables
Progress reports and process, product, and
service level measurements
TPMs
Rights Reserved 59/63
60. CPM–500 EVM/SE/TPM Integration
SMS Shall:
Monitor Progress Against the Plan
4.2.12.2 Monitoring
Contractor SHALL monitor progress against plan to
validate, approve, and maintain each baseline and
functional architecture
4.2.12.2.2 Required Product Attributes
Each documented assessment includes:
TPMs, metrics
Metrics and technical parameters for tracking that
are critical indicators of technical progress and
achievement
Rights Reserved 60/63
61. CPM–500 EVM/SE/TPM Integration
NASA EVM Guide:
Technical Performance
• NASA EVM Guide NPG 9501.3
– 4.5 Technical Performance Requirements (TPR): When
TPRs are used,
– appropriate and relevant metrics…
– must be defined in the solicitation
– Appendix A.7, 14.1 TPR
• Compares:
• Expected performance and
• Physical characteristics
• With contractually specified values.
• Basis for reporting established milestones
• Progress toward meeting technical requirements
Rights Reserved 61/63
62. CPM–500 EVM/SE/TPM Integration
Derivation and Flow
Down of TPMs
Document, Baseline,
IMS, EVM Parameter
IMP, Functional Baseline Measures Of Effectiveness (MOE)
IMP, WBS, Functional Baseline Measures Of Performance (MOP)
IMP, Allocated Baseline Technical Performance Measure
TPM Milestones And Planned
IMS
Values
Work Packages TPM% Complete Criteria
See next chart for linkage of technical baselines to technical reviews
Rights Reserved 62/63
63. CPM–500 EVM/SE/TPM Integration
Interesting Attributes of TPMs
Achieved to Date (sounds like EV)
Current Estimate (sounds like EAC/ETC)
Milestone
Planned (target) value (sounds like PV)
Planned performance profile (sounds like a PMB)
Tolerance band (sounds like reporting thresholds)
Threshold (yep, just what we thought)
Variance (sounds like variance!)
Rights Reserved 63/63