This document summarizes the findings of Working Group 4 from a conference on requirements traceability and adaptation in acquisition held from September 19-22, 2011. The working group found that:
1) There is currently not enough detailed requirements traceability from initial assessments through system retirement. Traceability needs to begin with required capabilities and end at system retirement.
2) Capability-based assessments and analysis of alternatives should be the primary steps in requirements traceability, but are often not connected to initial requirements documents and design documents.
3) Requirements traceability needs regular analytic updates as cost, schedule, performance and other assumptions change over the system lifecycle.
Why current sentiment analysis theory and practice is fundamentally flawed and what to do about it. Talk at the research session of the Sentiment Symposium in San Francisco on Nov 8, 2011.
Based on joint work with Dr. Ken Bloom.
Driving Innovation through Licensing Competitive Intelligence and Big Data…Paragon Solutions
To see the demo, download it here:
http://www.consultparagon.com/webinar-driving-innovation-through-licensing-competitive-intelligence-and-big-data-analytics.html
Today’s pharmaceutical companies are in a competitive brawl to rapidly identify, value and license promising drug candidates from external sources. This requires a significant investment in time and money, with no guarantee of success. To identify product opportunities ahead of a competitor requires a unique blend of competitive intelligence, advanced search and qualification technology, and the ability to quickly and accurately value a potential investment.
In this session, you will learn how to maximize the investment in time spent searching, qualifying and valuing new assets. This approach offers competitive advantage by putting key information used to decide whether to accelerate, abandon or hold on an opportunity at licensing and acquisitions executives’ fingertips.
Rocky Ganske, CEO, Axela Inc., talks about the lessons he's learned as an entrepreneur in the life sciences industry.
Part of the MaRS Future of Medicine(tm) series, an informal moderated forum bringing together research professionals and clinicians interested in drug development.
Learning from Big Data – Simplify Your Workflow Using Technology Assisted ReviewDaegis
Technology assisted review (TAR) or predictive coding has received both good and bad press in the eDiscovery arena. Proponents of TAR tout its abilities to speed up review and decrease costs without sacrificing accuracy. Opponents assert the technology is unproven and may be indefensible. Ultimately, it may be a necessity in the era of Big Data. This webinar examines the legal, economic, and technological issues surrounding conventional technology assisted review and new predictive technologies, and addresses the following:
- Is TAR becoming essential for law firms and legal departments?
- What are the risks associated with using TAR?
- Can TAR fit into existing workflows instead of requiring legal professionals to adapt to the technology?
- Can alternative methods of TAR relieve senior attorneys from the burden of creating seed sets to jump start reviews?
Featured Speakers:
- David Horrigan, Esq., Analyst, E-Discovery and Information Governance, 451 Research
- Anita Engles, Vice President of Product Marketing, Daegis
- Doug Stewart, EnCE, Vice President of Technology and Innovation, Daegis
Why current sentiment analysis theory and practice is fundamentally flawed and what to do about it. Talk at the research session of the Sentiment Symposium in San Francisco on Nov 8, 2011.
Based on joint work with Dr. Ken Bloom.
Driving Innovation through Licensing Competitive Intelligence and Big Data…Paragon Solutions
To see the demo, download it here:
http://www.consultparagon.com/webinar-driving-innovation-through-licensing-competitive-intelligence-and-big-data-analytics.html
Today’s pharmaceutical companies are in a competitive brawl to rapidly identify, value and license promising drug candidates from external sources. This requires a significant investment in time and money, with no guarantee of success. To identify product opportunities ahead of a competitor requires a unique blend of competitive intelligence, advanced search and qualification technology, and the ability to quickly and accurately value a potential investment.
In this session, you will learn how to maximize the investment in time spent searching, qualifying and valuing new assets. This approach offers competitive advantage by putting key information used to decide whether to accelerate, abandon or hold on an opportunity at licensing and acquisitions executives’ fingertips.
Rocky Ganske, CEO, Axela Inc., talks about the lessons he's learned as an entrepreneur in the life sciences industry.
Part of the MaRS Future of Medicine(tm) series, an informal moderated forum bringing together research professionals and clinicians interested in drug development.
Learning from Big Data – Simplify Your Workflow Using Technology Assisted ReviewDaegis
Technology assisted review (TAR) or predictive coding has received both good and bad press in the eDiscovery arena. Proponents of TAR tout its abilities to speed up review and decrease costs without sacrificing accuracy. Opponents assert the technology is unproven and may be indefensible. Ultimately, it may be a necessity in the era of Big Data. This webinar examines the legal, economic, and technological issues surrounding conventional technology assisted review and new predictive technologies, and addresses the following:
- Is TAR becoming essential for law firms and legal departments?
- What are the risks associated with using TAR?
- Can TAR fit into existing workflows instead of requiring legal professionals to adapt to the technology?
- Can alternative methods of TAR relieve senior attorneys from the burden of creating seed sets to jump start reviews?
Featured Speakers:
- David Horrigan, Esq., Analyst, E-Discovery and Information Governance, 451 Research
- Anita Engles, Vice President of Product Marketing, Daegis
- Doug Stewart, EnCE, Vice President of Technology and Innovation, Daegis
Closing the gap between Spend Analytics & Category Management_WeatherfordZycus
Consistent, accurate, timely, detailed spend analytics are just a starting point for Weatherford. This session by Procurement/SCM Director Michael Lariviere will focus on the collaboration he undertakes with Weatherford's spend category managers to ensure that spend analytics are being used to shape category management strategies and to drive outside-the-box thinking around how spend categories can be segmented and addressed by procurement.
ECR Europe Forum '05. Category Management in a limited data environment. Intr...ECR Community
Category Management in a limited data environment:
Category Management has been one of the most successful ECR tools over the past decade. At its core is what can be labour-intensive collation of accurate consumer information from many different data sources. But what if some data is missing? Learn how to maximize the benefits of Category Management in a limited data environment.
Strategies for making the most of SAP technology that supports Sales and Oper...Plan4Demand
866.P4D.INFO | Plan4Demand.com | Info@plan4demand.com
Presentation from SAP Insider SCM 2012 Conference, March 19TH Orlando, Florida.
The session, titled “Strategies for making the most of SAP technology that supports sales and operations planning (S&OP),” offers attendees expert advice, strategies, and technology guidance to increase efficiency in the S&OP process. McCall and Cecere provide a critical overview of the evolving and changing S&OP maturity model for today's supply chain, examine a realistic approach to evaluate an organizations’ S&OP maturity level, and reveal tips for overcoming obstacles and achieving positive results.
“We feel privileged to be recognized by the SAP conference planning committee as an expert in the field of business forecasting and planning. Collaborating with Lora Cecere is a great opportunity and our presentation is packed with analysis of current S&OP models, as well as advice on how to improve upon those models and increase a business’s S&OP process efficiency,” stated McCall.
“It seems that 95% of companies are unclear how to use their SAP solutions for S&OP,” said Cecere. “It starts with answering three basic questions and then applying the answers to these questions to a roadmap. Andrew, and I are partnering together to unveil these insights at SAP Insider.”
With the regulators moving forward with guidance on risk based monitoring, and the industry trend of
adopting this approach, this presentation will aim to demonstrate how the combination of CTMS, EDC
and analytics can be used to identify and manage site risk profiles. The presentation will draw from the
work completed by the MCC members and show how the Site Scoring tools for Site Selection and Study
Conduct can be used to generate a risk profile dashboard based on data from CTMS and EDC. The
presentation will further explore how data captured in CTMS and EDC can be used to update the risk
profile of the site during the course of the study, allowing the study team to proactively manage risk.
Nerac Inc., based in Tolland, CT, is a research and advisory firm for companies developing innovative products and technologies. Our analysts deliver custom assessments of product and technology development opportunities, competitive intelligence, intellectual property strategies, and compliance requirements. What we do directly impacts a company’s ability to succeed in a continually shifting landscape.
People that want to have an immediate impact work with Nerac.
Dr. Benetis briefly presented how modern, real time and automated technology from Lumension (Risk & Compliance Manager) is used to audit and monitor level of security in Lithuania's public sector. Presentation showed real use cases how solution made security measurement easier and more efficient. Dr. Benetis is also a president of ISACA Lithuania chapter.
Organisations are realising seriouness of cybersecurity and searching for ways to manage and govern it. How to organise security initiatives? How to monitor their success? How to build trust in own risk management? How to develop compliance management as a simple, but efficient and helpful instrument for everyone in organisation? Presentation will touch on practicalities of risk and compliance methods integration, and overall strategy to minimise costs of risk and compliance initiatives by using Lumension Risk Manager platform for public and private institutions.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
More Related Content
Similar to MORS WG: Requirements Traceability and Adaptation
Closing the gap between Spend Analytics & Category Management_WeatherfordZycus
Consistent, accurate, timely, detailed spend analytics are just a starting point for Weatherford. This session by Procurement/SCM Director Michael Lariviere will focus on the collaboration he undertakes with Weatherford's spend category managers to ensure that spend analytics are being used to shape category management strategies and to drive outside-the-box thinking around how spend categories can be segmented and addressed by procurement.
ECR Europe Forum '05. Category Management in a limited data environment. Intr...ECR Community
Category Management in a limited data environment:
Category Management has been one of the most successful ECR tools over the past decade. At its core is what can be labour-intensive collation of accurate consumer information from many different data sources. But what if some data is missing? Learn how to maximize the benefits of Category Management in a limited data environment.
Strategies for making the most of SAP technology that supports Sales and Oper...Plan4Demand
866.P4D.INFO | Plan4Demand.com | Info@plan4demand.com
Presentation from SAP Insider SCM 2012 Conference, March 19TH Orlando, Florida.
The session, titled “Strategies for making the most of SAP technology that supports sales and operations planning (S&OP),” offers attendees expert advice, strategies, and technology guidance to increase efficiency in the S&OP process. McCall and Cecere provide a critical overview of the evolving and changing S&OP maturity model for today's supply chain, examine a realistic approach to evaluate an organizations’ S&OP maturity level, and reveal tips for overcoming obstacles and achieving positive results.
“We feel privileged to be recognized by the SAP conference planning committee as an expert in the field of business forecasting and planning. Collaborating with Lora Cecere is a great opportunity and our presentation is packed with analysis of current S&OP models, as well as advice on how to improve upon those models and increase a business’s S&OP process efficiency,” stated McCall.
“It seems that 95% of companies are unclear how to use their SAP solutions for S&OP,” said Cecere. “It starts with answering three basic questions and then applying the answers to these questions to a roadmap. Andrew, and I are partnering together to unveil these insights at SAP Insider.”
With the regulators moving forward with guidance on risk based monitoring, and the industry trend of
adopting this approach, this presentation will aim to demonstrate how the combination of CTMS, EDC
and analytics can be used to identify and manage site risk profiles. The presentation will draw from the
work completed by the MCC members and show how the Site Scoring tools for Site Selection and Study
Conduct can be used to generate a risk profile dashboard based on data from CTMS and EDC. The
presentation will further explore how data captured in CTMS and EDC can be used to update the risk
profile of the site during the course of the study, allowing the study team to proactively manage risk.
Nerac Inc., based in Tolland, CT, is a research and advisory firm for companies developing innovative products and technologies. Our analysts deliver custom assessments of product and technology development opportunities, competitive intelligence, intellectual property strategies, and compliance requirements. What we do directly impacts a company’s ability to succeed in a continually shifting landscape.
People that want to have an immediate impact work with Nerac.
Dr. Benetis briefly presented how modern, real time and automated technology from Lumension (Risk & Compliance Manager) is used to audit and monitor level of security in Lithuania's public sector. Presentation showed real use cases how solution made security measurement easier and more efficient. Dr. Benetis is also a president of ISACA Lithuania chapter.
Organisations are realising seriouness of cybersecurity and searching for ways to manage and govern it. How to organise security initiatives? How to monitor their success? How to build trust in own risk management? How to develop compliance management as a simple, but efficient and helpful instrument for everyone in organisation? Presentation will touch on practicalities of risk and compliance methods integration, and overall strategy to minimise costs of risk and compliance initiatives by using Lumension Risk Manager platform for public and private institutions.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentations
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
1. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
Working Group 4
Requirements Traceability and Adaptation
David E. A. Johnson, Center for Advanced Defense Studies
COL (Ret.) Tom Loper, USA AC, Ultra Electronics
Mr. Chris Pernin, Rand
Mr. Ervin “Chip” Mueller, AMSAA
19-22 Sep 2011
Unclassified 1
2. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Participants
David Johnson • Frank Swehosky
Tom Loper • Alan Bohnwagner
Chip Mueller • Brett Johnson
Chris Pernin • Eric Harclerode
Patrick Cantwell • Mike Nieman
Jim Carr • T. W. Jackson
Cindy Noble • Dr. Shlomo Argamon
Willard Stratton • Tony Mckheen
• Julia Sharkey
Unclassified 2
3. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Background
Definition and Terms of Reference
Traceability– linking attributes across a process or system– is necessary in
order to ensure:
what is built meets original intent
as the world changes, 1st, 2nd, and higher-order effects can be
captured and appropriate decisions made in a timely manner.
Unclassified 3
4. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG 4 Objectives
•Assess how well requirements traceability is integrated into acquisition life
cycle
•Assess potential improvements, analytical methods and decision processes
to enhance the use of bi-directional traceability
•Discuss and record issues related to regulation and governance that may
impinge on adaptation of requirements and use of traceability techniques
•Develop recommendations for how to enhance traceability in current
requirements processes
Unclassified 4
5. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Impact of Requirements Traceability
If Not Done / Not Done Well
Reference points, direction and context are subject to varied opinions
and interpretations.
Leads to designs that don’t satisfy requirements. And don’t have
military utility that was originally envisioned.
Leads to disconnects & mis-matched activities & methods (design,
dev., cost, T&E, …)
Difficult to revise direction/to integrate
Difficult to maintain schedule – admin
Result in increased costs to construct ∆s, fix the mess, etc.
Limit trades available, increase risks and result in failed management
Unclassified 5
6. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Impact of Requirements Traceability
When Done Right
Provides a more complete initial set of purpose/objectives (starting
point).
Provides direction and context to System concept & development
(common view for User, Developer, DM, Analysis, T&E)
Provides structured framework for analyses (CBA, AoA, Cost, Trades,
Risk)
Captures internal & external incidents & the impact on requirements
and system development.
Allows more structured approach to develop consensus changes
Communicates the measures (cost, performance, schedule, new trades, new risks)
of interest
Enables delivery of cost-effective systems that have positive military
utility 6
Unclassified
7. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG 4 Findings
• There is currently no requirements traceability, in enough detail, from the
CBA through the retirement of the system
M
D
D A B C IOC FOC
Capabilities Based Materiel Solution Technology Engineering & Production & Operations
Assessment Analysis Development Manufacturing Deployment & Support
ICD AoA CDD CPD
• CBAs and AoAs should be the primary analytic steps in the requirements
traceability process
• ICDs are often separated from the CBA
• AoAs are not used as a “linking” process between ICDs and CDDs
= Lack of detailed traceability
Unclassified 7
8. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG 4 Findings
• Requirements traceability must begin with the required capabilities
and end with the retirement of the system from the force
• Requirements traceability needs analytic updates based on
information changes with regard to: cost, schedule, performance,
assumptions, environment, threat, risk, etc.
M
D
D A B C IOC FOC
Capabilities Based Materiel Solution Technology Engineering & Production & Operations
Assessment Analysis Development Manufacturing Deployment & Support
ICD AoA CDD CPD
Unclassified 8
9. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Finding
Numerous Requirements Management Software tools exist. WG4 identified
problem areas that limit the effectiveness of requirements management.
These areas are:
o Requirements Collaboration
“A cynical observation”
o Requirements Identification
Level of Involvement
o Requirements Utilization
Acquisition
User
Life Cycle
Unclassified 9
10. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Findings
Collaboration
“Requirements Engineering is a Team Sport”
Translators are needed between operators and
developers
Create and sustain Community of Practice
Unclassified 10
11. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Findings
Identification
Key Performance Parameters (KPPs) Must be re-examined
throughout the life cycle
By User
By cost and OR analyst
By acquisition side
Requirements are dynamic, explicit and implicit
Plan for Requirements Uncertainty and Risk
“Capability”/”Requirement” volatility can kill the program
Document Constraints and Assumptions early and evaluate iteratively
Capabilities, requirements, parameter, specifications require different
attributes for completeness
Unclassified 11
12. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Findings
Utilization
Process is not recursive enough and should be more flexible
AoA is early trade space discussion, and should be continuous throughout
Requirements volatility is an uncertainty/risk and impacts cost estimates
Requirements volatility can indicate changes to assumptions and constraints that
should be documented and addressed
Linkage between requirements , acquisition and programming needs improved
Unclassified 12
13. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Findings
The traceability matrix for each requirement should include:
Requirements source
Rationale (context for raw requirement(s))
Threat, environmental conditions, scenario
Cost curve*
Schedule
Utility/performance curve
Test needs
Traceability should ‘work’ up, down, & horizontally
* Capture point value, if possible capture curve – likely not available at MS A
Unclassified 13
14. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG4 Findings
Cost estimation data, methods, values, and curves should be maintained
and updated within the traceability matrix. This will facilitate
Earlier and more frequent analyses of costs and consideration of cost
drivers and their effects on program performance
Tighter linkage between program cost estimates throughout the acquisition
process, including
Cost Analysis Requirements Documents
Independent Cost Estimates
Earned Value Management
Unclassified 14
15. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
WG 4 Summary
Requirements are a team sport – operational community, acquisition
community, budget community, test community, logistics community
Analytic Rigor is needed – AoA should form the basis of periodic relook
Performance Utility Curve, Cost Curves
Recursive Analysis – Operational changes (threat, mission) to
Acquisition community,
Recursive Analysis - Acquisition community changes (affordability,
schedule) to operational community
Realistic Performance Thresholds
Affordable, rapid acquisitions will require less aggressive technical
solutions
Lower Performance Thresholds
More Performance Trade-space
Unclassified 15
16. Risk, Trade Space & Analytics in Acquisition Unclassified
19-22 September 2011 | Sheraton Premiere at Tysons Corner, Vienna, VA
Final Thoughts
Requirements Analysis must support periodic
assessment of Risk, Cost, and Trade-space analysis to
permit the Department of Defense and the Services to
achieve operationally effective and affordable systems
delivered to the Warfighter in a reasonable time.
Corruption
.
IO
Unclassified 16