Review these slides to learn all the features in Innoslate that implement Verification and Validation. These slides will cover: - Ensuring end-to-end traceability in your project - Model test processes through Diagrams View and Test Center - Developing test cases and test suites in Test Center - Creating Independent Verification and Validation (IV&V) plans and test plans through Documents View -Generate a traceability matrix These slides will give you a step by step approach to Verification and Validation.

1. VerificationandValidation(V&V)
withInnoslate®
Steven H. Dam, Ph.D., ESEP
President, SPEC Innovations
571-485-7805
steven.dam@specinnovations.com
1

2. • SPEC Innovations provides software, training, and
consulting to the defense and aerospace industries
and the intelligence community.
• Our flagship software product, Innoslate is the first
cloud-native, model-based systems engineering
software solution made solely in the United States
of America.
• Our engineers built Innoslate to help systems
engineers develop full lifecycle solutions to
complex system of systems.
• Innoslate software supports Requirements
Management, Modeling and Simulation,
Verification and Validation, and more in one
seamless package.
About Us
We are the experts in systems engineering
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 2

3. AskUsYourQuestions
• Ask us your questions using
the panel on the right
• This presentation is being
recorded and will be made
available to you.
• Contact us after the webinar
through
• support@Innoslate.com
• Call 571.485.7800
• LinkedIn Innoslate User Group
• Twitter
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 3

4. MeetYourHost
• President and Founder of SPEC
Innovations
• Participated in the development of C4ISR
and the DoDAF
• Expert Systems Engineering Professionals
Certificate
• steven.dam@specinnovations.com
• @stevenhdam
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 4

5. Overview
1. V&V in the Early Stages of the Lifecycle?
2. Preparing for V&V
3. Applying LML to V&V
4. What’s a Verifiable Requirement?
5. Developing a V&V Plan Using MBSE
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 5

6. 1. V&VINTHEEARLYSTAGES
OFTHELIFECYCLE?
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 6
What is Verification and Validation, The Lifecycle, Systems
Engineering During the Design Phase, Coming up the Vee

7. WhatisV&V?
• Verification: “the process of establishing the truth, accuracy, or validity of
something” [Google definition]
• Validation: “the action of checking or proving the validity or accuracy of
something” [Google definition]
In USG work these have taken on more
specific meanings
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 7

8. WhatisVerification?
• Meets specification-level requirements
• Proves that the solution-dependent requirements are satisfied
• Proves that solution was or is being built according to agreed requirements
Frequently the terms “Unit Test” and
“Developmental Test and Evaluation”
apply to verification
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 8

9. WhatIsValidation?
• Relates to customer and other stakeholder satisfaction
• Proves solution-independent requirements are being
satisfied
• Usually performed at the enterprise and/or system level
• In process validation helps ensure system will ultimately be
part of the accepted solution, in the target environment
Frequently the term “Operational
Test and Evaluation” applies to
validation
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 9

10. TheLifecycle
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 10

11. Requirements
Analysis
Functional Analysis
and Allocation
Synthesis
System Analysis and
Control
Best Use:
Architecture
Development
(To-Be)
SystemsEngineeringDuringDesignPhase
Best Use:
“Classical SE”
Best Use: Reverse
Engineering (As-Is)
Adapted from EIA-632
• V&V lives in
Systems
Analysis and
Control if we
use the MIL-
STD-499B
process
• We prefer
another
process for that
phase
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 11

12. ComingUptheVee
I&V Planning
Integration
Verification &
Validation
DesignMonitoring
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 12

13. 2.PreparingforV&V
What Do We Need to Do and What Do We Need?
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 13

14. WhatDoWeNeedtoDoEarly?
?
?
?
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 14

15. WhatDoWeNeed?
• Ontology that includes V&V information
• Verifiable Requirements (and/or Verification Requirements)
• V&V Plan
To do any of these things you need to
understand how to prepare for V&V, conduct
V&V activities, and report V&V results
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 15

16. 3. APPLYINGLMLTOV&V
LML’s Simplified Schema, V&V Extension of LML, Test
Actions
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 16

17. LML’sSimplifiedSchema
• Decision
• Input/Output
• Location
• Physical, Orbital, Virtual
• Risk
• Statement
• Requirement
• Time
• Action
• Artifact
• Asset
• Resource
• Characteristic
• Measure
• Connection
• Conduit
• Logical
• Cost
Supports capturing information
throughout the lifecycle
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 17

18. V&VExtensiontoLML
• In developing Innoslate’s new Test Center capability, we discovered the need
to add a subclass to Action: Test Case
• You may discover that you want to add other classes, attributes, and
relationships
• It’s easy to do so using the Schema Editor, but recognize that you may not
have readily available views and reports
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 18

19. TestCase(SubclassofAction)
• A Test Case entity represents a set of conditions
utilized to determine whether a system works as
intended.
• Properties (Attributes)
Name Type Description
Status ENUMERATION Status represents the current state of this Test Case.
Actual
Result
BIG_TEXT
Actual Results represents the results that are captured
after executing a Test Case.
Expected
Result
BIG_TEXT
Expected Result represents the result expected when
executing this Test Case.
Set Up BIG_TEXT
Set Up represents the prerequisites that must be
fulfilled before executing this Test Case.
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 19

20. 4.WHAT’SAVERIFIABLE
REQUIREMENT?
Requirements Analysis, Characteristics of Good
Requirements, What Makes a Requirement Verifiable,
Requirements Demo
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 20

21. RequirementsAnalysis
Source
Documents
External Interface
Database
User Needs
Decompose Requirements
Critical Issue?
Requirement
Verifiable?
Determine Options and Perform
Trade Studies
See System Analysis and
Control for details
Resolve Issues with Customer
YES
NO
Coordinate Changes to Make
Requirement Verifiable
NO
Review Statements and Risks
with Customer
Update Knowledgebase
YES
Identify Risks and Plan Mitigation
Updated
Requirements
Traceability Matrix
Preliminary Test
Requirements
Standards Selected
Change
Requests
SE
Knowledgebase
Trace Requirements to
Actions/Assets/Measures
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 21

22. CharacteristicsofGoodRequirements
• Each individual requirement should be:
• Correct: Describes the user’s true intent and is legally possible
• Complete: Express a whole idea
• Clear: Unambiguous and not confusing
• Consistent: Not in conflict with other requirements
• Verifiable: Provable (within realistic cost and schedule) that the system
meets the requirement
• Traceable: Uniquely identified, and able to be tracked to predecessor and
successor lifecycle items/objects
• Feasible: Able to be implemented with existing technology, and within
cost and schedule
• Modular: Can be changed without excessive impact on other
requirements
• Design: Does not impose a specific solution on design; says “what”,
Independent not “how”
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 22

23. WhatMakesaRequirementVerifiable?
• Need to answer the following questions:
• Can the requirement be met?
• By analysis, demonstration, inspection, modeling & simulation, or test?
• Will the user accept the results?
• Avoid words such as “excessive,” “sufficient,” “resistant,” etc.
• Make the requirement quantifiable
• Even “suitability” can be quantified
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 23

24. RequirementsDemo
• Using the FireSAT
sample project we
will show
• Analyzed
requirements
quality
• Derived verification
requirements
Source
Documents
External
Interface
Database
User Needs
Decompose Statements
Critical
Issue?
Statement
Verifiable?
Determine Options and
Perform Trade Studies
See System
Analysis and
Control for details
Resolve Issues with
Customer
YES
NO
Coordinate Changes to
Make Statement Verifiable
NO
Review Statements and
Risks with Customer
Update Knowledgebase
YES
Identify Risks and Plan
Mitigation
Updated
Requirements
Traceability Matrix
Preliminary
Test
Requirements
Standards
Selected
Change
Requests
SE
Knowledgebase
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 24

25. 5.DEVELOPING AV&V
PLANUSINGMBSE
Verification Process, Creating a Test Plan, Test Demos,
Creating a Test Process, Using the Test Center, Other
Testing Activities
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 25

26. VerificationProcess
SE Knowledgebase
Review Test Results with ERB
Develop Deployment Plan and
Conduct Beta Testing
Assess Risk and Plan Mitigation
Updated SE
Knowledgebase
Return Item to “Integrate Solution”
(if necessary)
Beta Test
Report
Deficiencies?
YES
NO
Workaround
Identified
Verify to Requirements
Verification
Requirements
From Design &
Analysis Phase
Perform Regression Testing
Acceptable
Regression Tests?
YES
NO
Deployment Plan
Submit Changes to CM Process
Regression Test
Report
Inspection and Test
Report
Updated Test
Plan
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 26

27. CreateaTestPlan
Choose “Test
Plan Document”
for Type, then
assign a Number,
Name and
Description
In Documents View,
click “+ New
Document”
Click
“Finish.”
Choose the
Template,
“Blank
Document”
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 27

28. TestPlanningDemoI
• Show Test Plan in
Documents View
• Discuss techniques
used to complete the
test plan
• Show relationships
between test plan
elements and the
design
SE Knowledgebase
Review Test Results with ERB
Develop Deployment Plan and
Conduct Beta Testing
Assess Risk and Plan Mitigation
Updated SE
Knowledgebase
Return Item to “Integrate Solution”
(if necessary)
Beta Test
Report
Deficiencies?
YES
NO
Workaround
Identified
Verify to Requirements
Verification
Requirements
From Design &
Analysis Phase
Perform Regression Testing
Acceptable
Regression Tests?
YES
NO
Deployment Plan
SubmitChanges to CM Process
Regression Test
Report
Inspection and Test
Report
Updated Test
Plan
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 28

29. CreateaTestProcessorCase
• Use
Action
Diagram
to create
process
• Link test
process
to test
plan
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 29

30. MakeSuretheTestCaseWorksUsingSimulation
Explore the variation of individual steps to execute the
model over many iterations using the Monte Carlo
Simulator
Watch test case execute at all
levels using the Discrete Event
Simulator
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 30

31. TestPlanningDemoII
• Show test cases
• Built model using
Action Diagram
• Run simulators to
verify models
• Show traced test
cases back to
verification
requirements
SE
Knowledgebase
Develop/Revise Context
Diagram
Determine Options and
Perform Trade Studies
See System Analysis and
Control for details
Review Model and Risks with
Customer
Identify Risks and Plan
Mitigation
Updated SE
Knowledgebase
Develop Series of Scenarios
for Analysis
Create/Update System
Behavior Model
Analyze Behavior Model
Performance
Behavior Model
• Control Flow
• Data Flow (Activity Model)
• Performance Criteria
Allocate Actions to Assets and
Input/Outputs to Conduits
Updated SE
Knowledgebase
Detailed
Operational
Concept
Operational
Requirements
Document
(ORD)
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 31

32. UsetheTestCenter
• Capture as part of test plan
• Link back to requirements
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 32

33. OtherTestingActivities
• Test Equipment and Facilities (Assets)
• Test Organization (Assets) and Roles/Responsibilities
(Statements)
• Risks and mitigations (Many)
• Criteria (Characteristics/Measures)
• Schedule (Timeline and/or process simulation output)
• Cost (WBS linked to processes)
• Data capture (actual Measures and Times)
• Artifacts
• Location
• Decisions (assumptions, issues, etc.)
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 33

34. WhatDidWeCover?
1. V&V in the Early Stages of the Lifecycle?
2. Preparing for V&V
3. Applying LML to V&V
4. What’s a Verifiable Requirement?
5. Developing a V&V Plan Using MBSE
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 34

35. Questions and
Answers
Use the panel on the right to ask your questions
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 35

36. Next Webinar
Why Do Projects Fail? What is Model-Based Program Management (MBPM)? How
can Innoslate help me do MBPM? How to perform Model-Based Reviews (MBR)
Using Innoslate for Program
Management
Tuesday, October 6 @2pm EDT
Go To Webinar
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 36

37. Save the Date: MBSECON
The Lifecycle Modeling Language Presents:
The Model-Based Systems Engineering
Conference #MBSECON
Virtually | February 22 – 24, 2021
www.mbse.heysummit.com
Join us for MBSECON, the conference for dedicated
systems engineers who want to achieve the digital
future.
Listen to experienced speakers, invited papers, panel
sessions and learn more about our sponsors with our
unique and immersive networking platform.
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 37

38. MoreResources
SPEC Innovations offers training, books, videos, documentation, trials, and more
Training: specinnovations.com/training
Books: “Real MBSE” textbook and lab manual available on
Amazon
Videos: Visit the SPEC Innovations Youtube channel
LinkedIn: Innoslate and Systems Engineers User Group
Documentation: help.Innoslate.com
Trial: cloud.Innoslate.com
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 38

39. SPEC Innovations offers training, books, videos, documentation, trials, and more
Thank you!
Visit cloud.innoslate.com for a trial.
SPEC Innovations
@Innoslate
Innoslate User Group
Innoslate.com/blog
571.485.7800
innoslate.com
Proprietary of SPEC Innovations® 09/02/2020 at 2pm EDT, Dr. Steven Dam 39