Multi-dimensional Clustering Analysis

1. Multi-dimensional Clustering Analysis
Ex: Cluster on Information
Location(A/C)
Conduct_DCA_Intercept_&_Escort
Issue_Level_1_Query
Clear_Aircraft_Departing_CV
ID(Track)
Range(Track,USN_Ship)
IFF(A/C)
Engagement_solution
Engagement_order
IFF(Track)
Location(Track)
Review_ID_Indicators
Respond_to Air_Threat
Conduct_Threat_Assessment
Issue_DMZ_Violation_Report
Control DCA
Conduct_Threat_
Assessment
Conduct_Engagement
_with_Birds
Control_
DCA
Review_ID_
Indicators
Location(A/C) 0 0 1 0
Location(Track) 1 1 1 1
Range(Track,USN_ships) 1 1 0 0
Engagement_solution 1 1 0 0
Engagement_order 0 1 0 0
IFF(A/C) 0 0 1 0
IFF(Track) 0 0 0 1
ID(Track) 1 0 0 1
Conduct_Engagement_with_Birds
Information
features
• Goal: Maximize
information within
watchstanders;
minimize info overlap
when unnecessary
• Conduct_DCA &
Control_DCA use
similar info;
Review_ID &
Conduct_engage-
ment do not.
Info
Task

2. Phase D: Engineering Team Interactions
Uniquely assign tasks when possible to minimize
routine communications between team members
May need to split tasks if individuals are overloaded
Detailed Modeling Tool:
Note: Splitting tasks introduces
new communication workload
Information Variables
Decision Variables
Action Variables
Outcome Variables

3. Initiate/Confirm Engage Order
Engage_with_Birds
In-bound
missile msg
ROE
Track’s failure to
respond to Level II Warning
Track’s failure to
respond to Illumination
System Status
Track Verbal Report
Engagement Status
Weapons Away (Y/N?)
Engagement Order
Kill Evaluation (Y/N?)
‘Initiate/Confirm
Engagement’Msg
‘Produce Engagement
Solution’Msg
‘Weapons Ring’Msg
‘Issue Track Report’Msg
‘Kill Evaluation’Msg
Release Missiles
Track’s visual
display profile Track is covered (Y/N?)
System’s moving
twds releasing Weapons (Y/N?)
Firing Solution
still a go (Y/N?)
In-bound
Missile (Y/N?)
Track’s meeting
ROE (Y/N?)
Track’s approaching
its weapons range (Y/N?)
Initiate Engage Orders (Y/N?)
Engagement Solution
Weapons
Away Yes
Kill Yes
Track is covered
System’s moving
twds releasing Weapons
Firing Solution
still a go Yes
Engage Orders
Initiated
Firing Solution
no longer a go
System’s failed in
movingtwds releasing
Weapons
Engage Orders
NOT Initiated
Track is
NOT covered
Weapons
Away No
OUTCOME Variables
DECISION Variables
INFORMATION Variables
ACTION Variables
OUTCOME Variables
DECISION Variables
INFORMATION Variables
ACTION Variables
Respond_to_air_threat
Evaluate_threat
Intra- and inter-task analyses suggest
opportunities to combine tasks into roles
3
2
Intra- and Inter-Task Analysis

4. Example Objective:
Balancing Workload in the Team
Instant Workload
0
Threshold
)
(
)
( max
0
;
max
arg
max t
W
t
W i
DM
i
DM
t
t
AEGIS
i
DM
MMWS
i
DM 




Objective 1:
min
)
(
)
(
max
max
0
0
min
arg
max
arg









t
t
i
DM
t
t
i
DM
t
W
t
W
MMWS
i
DM
MMWS
i
DM
Workload Accumulation
Balance
DM1 DM2 DM3 DM4 DM5

5. 1 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Team Leader
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Air Coordinator
-
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Watchdog
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Information Coordinator
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Battle Manager
Notional Workload Analysis

6. Outline of Presentation
Value of modeling C2 Organizations
– Prescriptive vs. descriptive modeling
– Model-Based Experimentation
TIDE modeling approach
C2 Design Example: AWACS
How to use TIDE products

7. AWACS Design Challenge
TIDE Design Approach
 Mission analysis
 What needs to be done
 What information is available
 Task analysis
 How is it done
 What information is used
 Organizational analysis
 How is information shared
 Who does what
How do you design an optimal
command & control teams for
complex, variable AWACS missions
to take advantage of advanced
information fusion technology?

8. Example: AWACS Crew Optimization
Human-Centered Re-Engineering of AWACS Command
and Control Teams (REAC2T)
– Phase III SBIR Project funded by AWACS System Program
Office ESC, Hanscom AFB
Demonstrate proven, scientific approach to C2 team
design in AWACS domain
– Team Integrated Design Environment (TIDE)
Present ACC/Wing with proof-of-concept for crew
optimization
– Evaluate impact of information fusion on mission performance
and operator functions
– Introduce optimized team structures to enhance mission
performance

9. AWACS Example:
Inputs to Mission Model
Mission decomposition and evaluation
– Work with operational community to define current approach to
mission completion
• CONOPS, tactics, roles, and responsibilities
Red Flag Spin-Up Training
– Tinker AFB
Live Fly Red Flag Exercises
– Five flights, Nellis AFB
Cognitive Task Analysis
– Wing Tactics Office, Tinker AFB
– SD instructors Fighter Weapons School, Nellis AFB

10. TIDE Prototype Software
Mission & task graphs are
converted into data tables to serve
as input for optimization algorithms

11. Preliminary Results:
Baseline 14 Operator Task Distribution
Colors represent unique operational tasks
Max Workload = 1400

12. Impact of Technology (MSI) Insertion:
Non-Optimized 14 Operator Configuration
Colors represent unique operational tasks
Max Workload = 950

13. Impact of Technology (MSI) Insertion:
Optimized 14 Operator Configuration
Colors represent unique operational tasks
Max Workload = 750

14. Impact of Technology (MSI) Insertion:
Optimized 12 Operator Configuration
Colors represent unique operational tasks
Max Workload = 800

15. Internal Communication:
Outgoing Messages
MSS W1S W2 W3 W4 W5 W6 S1S S2 S3 S4 S5
0
20
40
60
80
100
120
140
DMs
Outgoing
Messages
MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3
0
20
40
60
80
100
120
DMs
Outgoing
Messages
Baseline
MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3
0
50
100
150
200
250
300
350
400
450
500
DMs
Outgoing
Messages
MSI Non-Optimized 14
MSI Optimized 14 MSI Optimized 12
MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3
0
20
40
60
80
100
120
140
160
DMs
Outgoing
Messages
1. Technology
Insertion
500 160
3. Manning
Optimization

16. Summary: Model-based Re-Engineering of
AWACS Command & Control Teams (REAC2T)
T91 -Record
keep - Significant
events
T76 - Provide C2
for workarounds
to appropriate
players
T75 - Coordinate
with senior C2
elements
T74 - Define/
recommend
mission
modifications
T71 - Define what
is needed to
continue/
complete mission
T62 - Send an
arrow
T60 - Broadcast
new information
T57 - Request
support from
supervisor
T47 - Distribute
mission status
T46 - Provide
vector information
(i.e. refueling, flight
join, airspace)
T43 - Respond to
requests for
information (RFI)
T42 - Make
picture calls
T26 - Identify air
threats
T24 - Provide all
available amplifying
information (tracks)
T20 - Utilize
organic radar
data
T19 - Fuse data
from multiple
sources to locate
objects (detect)
T7 - Reconfigure
radar for
changing mission
objectives
T102 - Receive
information from
pilots
T45 - Monitor
airborne assets
mission
readiness
T48 - Assess
fighter fuel level
T103 - Pull
information from
pilots
AND
OR
AND
OR
AND
AND
OR
AND
A17 - Fuse data from
multiple sources to
ensure tracks are
correct
A12 - Detect
new track
D28 - Determine
where you should
anticipate a threat
D16 - Decide
what is a valid
air object (track)
I17 -
Intelligence
data
I4 - ATO
I64 - Radar
Data
I65 - IFF
Data
I66 - ESM
Data
I67 - Other
Sensor
A2 - Initiate
Track
Symbology
Switch Action
AND
O39 - Track
symbology
I56 - Track
position
 Re-engineering based on AWACS mission task models
 Scientific C2 team design approach to AWACS domain:
TIDE -Team Integrated Design Environment
 Org. design for new technology insertion and optimized manning
0
2
4
6
8
10
12
Baseline New Tech
Only
New Tech +
Optimized 1
New Tech +
Optimized 2
Crew Configuration
Average
Task
Delay
(seconds)
Task
Model

17. Outline of Presentation
Value of modeling C2 Organizations
– Prescriptive vs. descriptive modeling
– Model-Based Experimentation
TIDE modeling approach
C2 Design Example
How to use TIDE products

18. TIDE Model Products
Mapping of Tasks
to Team Members
Task Cluster Output
DM1 DM2 DM3 DM4 DM5
Configure_Watchstation 1 1 1 1 1
Plan/Configure_for_Air_Defense_Mission 1 1 1 1 1
Review_Systems_Status 1 1 1 1 1
Issue_Level_1_Query 0 0 1 0 0
Respond_to_Air_Threat 1 0 1 1 0
Conduct_Engagement_with_Birds 1 0 0 1 0
Review_ID_Indicators 3 1 2 2 4
Issue_Update_Track_Verbal_Report 0 0 0 1 0
Conduct_DCA_Intercept_&_Escort 1 0 0 1 1
Issue_DMZ_Violation_Report 2 1 1 1 1
Clear_Aircraft_Departing_CV 0 0 0 0 1
Team
Descriptions
4.0
4.1
4.2.1 4.2.2
4.3
CAS (8)
CV (1)
TARP (1)
Rifle Co (3)
Stinger (1)
4.2
Cobra (2)
Rifle Co (3)
Cobra (2)
Stinger (1)
Eng . (1)
MED (1)
MCM (1)
CG(1), DDG(2)
Eng . (1)
MED (1)
MCM (1)
VF(8), FFG(2)
Performance Predictions
1 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Team Leader
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
AIC-REDCROWN
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Watchdog
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Information Coordinator
101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Battle Manager
Detailed Specification of Team Roles:
 When Tasks are performed
 How Decision are made
 What Resources are used
 What Information is used
 What Communications are required

19. Multiple Applications of TIDE Model
Synthetic Task Environments
TIDE Organizational Design Process
Phase A:
Mission
Representation
Phase B:
Task-Resource
Mapping
Phase E:
Organizational
Structuring
Phase C:
Clustering Tasks
into Roles
Event-Task
Mapping
Optimized Task
Scheduling
Operator Role Definition/
Info Requirements
Team-Level
Assignments
Team Design
(Structures
+
Processes)
Design
Objectives,
Criteria,
Constraints
Design
Objectives,
Criteria,
Constraints
Phase D:
Decomposition
of Role Overlap
Organizational Design
Intelligent Agents
Training Programs
Tide Input Model
IDAO Decomposition
A31 - Target the
threat
D4 - Decide
how to use
available air
and ground
resources
O14 - Commit pair
fighters
I49 - Fighter
weapons
status
I19 - Mission
requirements
and priorities
I41 - Fighter
fuel status
I51 - Threat/
target
location
AND
I17 -
Intelligence
data
A22 - Monitor the
air picture
IDAO Decomposition
Event-Task Mapping
Time on Target (ToT)
T36 - Maintain
accurate track /
symbology
correlation
T19 - Fuse data
from multiple
sources to locate
objects (detect)
T22 - Interpret /
Filter information
T20 - Utilize
organic radar data
T95 - Monitor
airspace
T42 - Make picture
calls
T86 - Provide
target location
T43 - Respond to
requests for
information (RFI)
T24 - Provide all
available amplifying
information (tracks)
OR
T102 - Receive
information from
pilots
T56 - Receive
mission effectiveness
/ BDA
T47 - Distribute
mission status
AND
Event-Task Mapping
Task Decomposition
ID/track air objects
Respond to threats
Record keeping
ASK FOR INPUT
to ATSO (self-preservation)
Identify Threat type
Identify Threat
Locations
Direct weapons to target/threat
Analyze system resources
to locate jammers while
Monitoring system for jamming
Execute electronic counter
measures while Monitoring
system for jamming
Broadcast jammer location
while Monitoring system
for jamming
TCTC Mission
Define Threats
Decide to engage or not
Operate MCS systems
Surveillance/detect
air objects
Create/maintain recognizable
& integrated air picture
Pass/receive information
Manage ATO execution
ATSO (self preservation)
Airborne (C2 of airborne assets)
Respond to Threats Respond to pop
-up targets
Monitor system for jamming
ID/track air objects
Respond to threats
Record keeping
ASK FOR INPUT
to ATSO (self-preservation)
Identify Threat type
Identify Threat
Locations
Direct weapons to target/threat
Analyze system resources
to locate jammers while
Monitoring system for jamming
Execute electronic counter
measures while Monitoring
system for jamming
Broadcast jammer location
while Monitoring system
for jamming
TCTC Mission
Define Threats
Decide to engage or not
Operate MCS systems
Surveillance/detect
air objects
Create/maintain recognizable
& integrated air picture
Pass/receive information
Manage ATO execution
ATSO (self preservation)
Airborne (C2 of airborne assets)
Respond to Threats Respond to pop
-up targets
Monitor system for jamming
Mission Decomposition
ID/track air objects
Respond to threats
Record keeping
ASK FOR INPUT
to ATSO (self-preservation)
Identify Threat type
Identify Threat
Locations
Direct weapons to target/threat
Analyze system resources
to locate jammers while
Monitoring system for jamming
Execute electronic counter
measures while Monitoring
system for jamming
Broadcast jammer location
while Monitoring system
for jamming
TCTC Mission
Define Threats
Decide to engage or not
Operate MCS systems
Surveillance/detect
air objects
Create/maintain recognizable
& integrated air picture
Pass/receive information
Manage ATO execution
ATSO (self preservation)
Airborne (C2 of airborne assets)
Respond to Threats Respond to pop
-up targets
Monitor system for jamming
ID/track air objects
Respond to threats
Record keeping
ASK FOR INPUT
to ATSO (self-preservation)
Identify Threat type
Identify Threat
Locations
Direct weapons to target/threat
Analyze system resources
to locate jammers while
Monitoring system for jamming
Execute electronic counter
measures while Monitoring
system for jamming
Broadcast jammer location
while Monitoring system
for jamming
TCTC Mission
Define Threats
Decide to engage or not
Operate MCS systems
Surveillance/detect
air objects
Create/maintain recognizable
& integrated air picture
Pass/receive information
Manage ATO execution
ATSO (self preservation)
Airborne (C2 of airborne assets)
Respond to Threats Respond to pop
-up targets
Monitor system for jamming
0 200 400 600 800 1000
Line
1
T18
T68
T28 T20 T66 T70 T67 T69 T71 T28 T83 T83 T83
Line
2
T18
T18
T28 T20 T37 T67 T69 T71 T95 T44 T71 T83
Line
3
T18
T20 T20 T67 T69 T71 T83
Line
4
T18
T18
T18
T18
T20 T66 T69 T71 T44 T98 T70
Line
5
T28
T18T20 T20 T90 T67
Line
6
T28 T20 T20 T92 T28 T83 T1
Line
7
T28
T18
T20 T92 T28 T9 T83 T44 T83 T87
Line
8
T18
T18
T18T20 T20 T65 T64 T69
Line
9
T4
T18 T66 T77 T70 T81 T69
Line
10
T28 T20 T97 T83 T83 T83
Line
11
T18
T18 T16 T9 T83
Line
12
T18
T18 T16 T27
Line
13
T18
T28 T20 T2 T83
Line
14
T20 T20 T37
Line
15
T18
T18 T20
Line
16
T18
T18 T20
Line
17
T18
T18 T20
Line
18
T28 T20
Line
19
T89
Line
20
T20 T20
Line
21
T16
Line
22
T20 T20
Line
23
T20
Time
C2 Process Re-engineering
Interface Design

20. Model-driven Measurement Process
Learning Objectives
in JTF Environment
Competencies:
Knowledge, Skills,
and Abilities
Tasks
Scenario
Stimulated or Trained by...
Improve by X%
Put together into vignettes...
Individual
Team
Team-of-Teams
Theories of
Performance Link
Skills to Behaviors to
Tasks
Stories and
events
MOPs &
Measurement
Tools
Measurement
Challenges
Performance Measures by Task
How well did learners perform?
KSA Assessment
What KSAs do learners have/lack?
Diagnose individuals’needs for additional training
Success in Meeting Training Objectives
How well are training objectives met?
Success at JTF; Certification
Subject Matter Experts
TIDE Model

21. TIDE Integrated Toolset
Task Network Simulation
Organizational Structure
Task Hierarchy
Assess
platform
needed
Receive
platform
status
Assess
need to
request
Task
Platform,
DM Platform
Task,
Platform
Task,
Platform
Task,
Platform, DM
Decision-Maker Model
DESIGN
SIMULATION-BASED
EVALUATION
ANALYSIS
Team Optimal
Design (TOD)
T
DM
R
User/SME
input and review
Mission
Analysis
Sub 3
Sub 1 Sub 2
Lead
Sub 2 Sub 3
Sub 1
Leader
Computational Organization Model
50 100
60 70 80 90
85.1
79.7
76.2
Mission
Outcome

22. Some Current Military Applications
of the TIDE Modeling Methods and Tools
Joint Task Force Adaptive Architectures for Command and
Control (A2C2)
Next Generation Navy Surface Ships (SC-21/DD-21)
Human-Centered Re-Engineering of AWACS Command and
Control Teams (REAC2T)
Uninhabited Combat Air Vehicle (UCAV) Control Center
Kwajalein Radar/Missile Control Center (ATIDS)
Air Operations for Time Critical Targets (JFACC)
Time Critical Targeting Cell in Air operations (CAOC)
Effects-Based Operations in Operations Center (EBO)
Army Future Combat Systems (FCS)
Global Wargame JTF Org. Design and Assessment
….

23. Summary: Why Model C2?
TIDE is a method to optimize decision-making organizations to
capitalize on advanced technology
Model-based organizational structures are “congruent” with mission
needs
Modeling guides experimentation and performance assessment
Analysis and design tool for system designers
– Cost and risk reduction
– New technology payoffs
Mission/organization model serves multiple purposes
– Organizational design: Provide alternative, optimized organizations
– Team training: Highlight areas for team training
– Synthetic tasks: Develop environments to train and evaluate teams
– Interface design: Functional definition of GUI