Series of six rating sheets to provide a high-level, subjective evaluation of the design of various elements of a Human Performance Engineering Program. Sheet #1 is for the Conduct of Operations (ConOps) program.

1. Conduct of Operations Rating Sheet
No/Strongly Disagree
0
Disagree
1
Agree
2
Strongly Agree
3
Question
Procedures
A written requirement exists (and is rigorously followed) for all operations to be performed in accordance
with procedures using “thinking compliance”.
A systematic risk-based process is used to classify procedures according to usage. (For example, “use
every time” with check-off for each step, or “reference” - simply follow the guidelines of the procedure
from memory.)
A formal process is in place for validating, verifying, and approving procedures; the process is used for
new procedures as well as revisions.
All procedures are written in accordance with a procedure writer’s guide to assure “best practice” in human
factors design and consistency in format.
Training
Written policies exist and are followed that describe the requirements for supervision and control of
training and safe operation during on-shift training exist and are adhered to .
Written policies exist and are followed that require performance-based training with objectives and
measurable qualification standards based on specific job performance requirements .
Minimum technical and instructional qualifications for trainers and evaluators are documented, and all
trainers meet at least minimum qualifications.
Requirements exist for developing and administering written exams and performance evaluations (actual
performance or simulation of tasks), which are used as part of the process to establish and maintain
qualifications.
Failure policies, including remedial actions and temporary or permanent loss of qualification, are clearly
specified, well understood by all personnel, and consistently practiced .
Requirements for maintaining proficiency (including minimum time annually for active participation onthe-job, re-qualification after extended absence, and selected training requirements for individuals who fail
to maintain minimum proficiency requirements) are documented and followed .
Requirements for safe performance of periodic drills and monitored evolutions are well documented and
consistently followed.
Communication
Required reading is used as a communication tool, not to meet training needs.
Written policies and guidance exist to assure that adequate time and opportunity are afforded all personnel
to read procedure change notifications, operational experience or incident reviews .
Closed-loop communication (operational information is repeated back and confirmed prior to acting) is
taught to all personnel and is standard practice for all verbal communications .
Phonetic alphabet is used whenever acronyms or letters alone could be misunderstood .
Strict adherence to policies for business-only use of all in-plant communication systems is enforced.
An efficient method (preferably a single method) of communication between on-shift operators and all
groups who need to communicate with them exists and is consistently used.
Configuration Control
Score
(0 - 3)

2. Question
Score
(0 - 3)
Configuration Control
Only authorized and trained personnel manipulate equipment at the facility .
A safety observer is required for any job that has high potential for personnel injury. Specific requirements
exist specifying the roles and responsibilities of the safety observer and requirements for training.
Operations uses status boards, or some other effective means, to track and communicate equipment status.
Policies and specific written requirements exist for system alignments, locking out of components and
authorization to remove equipment from service or restore equipment to service.
Efficient means for documenting equipment deficiencies exist and are consistently applied by all personnel.
Requirements for testing following maintenance, repair or new installation are clearly specified.
Particular attention is paid to maintaining operational status of alarms and clearly indicating alarm
operational status to all operating personnel.
Independent verification activities are implemented by appropriate policy and procedures to ensure correct
operation and control of designated systems, structures and components important to safety and reliability.
Requirements are in place to control and document any time a safety system is disabled .
Policies and specific guidance exist and are implemented to control the labeling of equipment and piping to
provide consistency and to assure application of sound human factors principles.
A comprehensive Management of Change (MOC) program is a routine part of process safety management;
operations personnel are trained in MOC and actively involved in implementation of the program.
No system change is released until all necessary operations/maintenance procedure changes and training
have been completed.
Operations
A systematic process for self-checking and verification exists, all personnel have been trained in use of the
process, and the process is routinely used by all operations personnel .
Narrative logs are used to record major equipment manipulations, unusual conditions, or other significant
occurrences. These logs provide a history of the significant events that occur at the facility.
Operating logs and associated checklists contain expected ranges of parameters to be recorded.
Guidelines and requirements are established to assure that control-area activities are conducted in a
professional, disciplined manner that supports the highest standards of safety and effectiveness .
Limitations are placed on the number of people allowed in the control area and operators have the authority
to clear the area if they feel that excessive noise or activity is distracting them.
Formal requirements for conducting and documenting shift change exist and are supported and enforced .
A written shift turnover checklist is used to ensure the complete transfer of information.
Facility walk-downs are required by on-coming shift personnel accompanied by off-going shift.
Total
Scoring:
89 – 111…………….Well designed ConOps program. Continue to monitor and enhance performance.
65 – 89……………...Overall operational practices are adequate, some areas may require improvement.
45 - 64………………Significant deficiencies exist which have a negative impact on safe, efficient operations.
Less than 45…………Major systematic problems with operational practices.