The performance improvement project plan for the Ohio Department of Health focuses on evaluating an online seminar for emergency response coordinators to enhance their public health emergency preparedness capabilities. Key objectives include assessing the seminar's quality, ensuring it meets training objectives, and improving overall ERC capacity. The project will use Kirkpatrick’s model for evaluation and involves multiple stakeholders, including local health commissioners and public partners, to effectively address performance gaps identified in the ERC role.

1. Performance Improvement Project Plan
Overview
 Client: Ohio Department of Health
 Team Members:
o CT - Thomas Muldrow, Consultant - primarily responsible for the successful
completion of a project
o PS – Tamara McBride, Bureau of Health Preparedness, Chief (Project Sponsor) -
responsible for the success of a project and provide necessary guidance and
resources to the project team
o PM – Renee Dickman, Project Manager - ensure that the project’s objectives
solve existing business problems or enhance performance, and add value to the
organization
o BT – Advisory group of health commissioners
 Type of project: Performance Improvement
 Project purpose: The purpose of this project is to determine the effectiveness of the
online seminar for ERCs conducted by BHP. This is extremely important to the Ohio
Department of Health because the ERCs are the main individuals within the LHD tasked
with public health emergency preparedness. This is also important because it will help
raise the overall level of preparedness for the state of Ohio and will serve as a launching
point for additional specialized training in the future.
The client is currently working on an online seminar for the new Local Health
Department (LHD) Emergency Response Coordinators (ERC). There has been significant
turnover in the position which has been exacerbated by the COVID-19 pandemic. There
is also a significant gap in performance among existing ERCs that needs to be addressed.
The Bureau of Health preparedness has developed an online seminar for new ERCs and
is looking for an evaluation plan to assess the training and improve overall capacity at
the position.
 Objectives:
o Assess the quality of the online seminar
o Ensure the seminar meets the objectives of the training
o Develop process for evaluation of future iterations of emergency preparedness
training
 Goals:
o Improve overall ERC capacity and capability in the position
o Provide clarification of ODH expectations and improve coordination among the
department and its subrecipients
o Increase emergency preparedness capabilities in the local health departments
o Mitigate the impacts of public health emergencies with the state of Ohio

2.  Target audience:
o New ERCs
o Tenured ERCs
 Stakeholders:
o Ohio Department of Health
o Local Health Commissioners
o Residents within the county
o Other county public partners
o Local healthcare system
Project scope
The scope of the project includes addressing the human performance needs of the Ohio
Department of Health by developing an evaluation plan for their recently created online
seminar. The performance gap has been identified and the Bureau of Health Preparedness
(BHP) has developed a training program to address the problem. This project has been
contracted to evaluate the training program and its impact on the capability of the Emergency
Response Coordinators (ERCs) once they arrive at their respective health departments.
The evaluation will focus primarily on the increase in knowledge and understanding of the main
responsibilities of the job (including interactions with ODH). The evaluation will use Kirkpatrick’s
model to:
 Measure how participants react to the training
 Analyze if the ERCs truly understand the training (if there is an increase in knowledge
and understanding), and
 If the ERCs are utilizing what they learned in the execution of their duties at the Local
Health Department
 Key deliverables
o Evaluation Plan
o Level 1 (Reaction): Course evaluation at the completion of the online seminar
o Level 2 (Learning): Pre-test on day 1 of training
o Level 2 (Learning): Post-test at completion of training
o Level 3 (Behavior): Self-reported assessment
o Recommendations based on analysis and interpretation
 Resource needs
o Laptop – consultant able to use personal computer
o Cloud based survey tool – SurveyMonkey

3. o LMS – OhioTRAIN (catalog of training for public health in Ohio)
o Collaboration platform - MS Teams
o Printer – available onsite
 Major milestones
o Complete Project Plan
o Needs analysis
o Complete Evaluation Plan
o Draft instruments complete
o Gather data (course evaluations, pre/posttests, checklists)
o Analyze and interpret the results of the evaluation
o Report and make recommendations based on evaluation results
o Project Turnover
 Assumptions and dependencies
o There will be sufficient time to beta test instruments prior to the online seminar
o The project will not expand beyond the initial project scope
o There will be enough participants in the training to provide a valid assessment
o There are no specific software programs required to implement the proposed
workforce development plan. Everything can be accomplished using off-the-shelf
software

4. Detailed work plan (matched to key deliverables and major milestones)
 Major activities to be accomplished (Estimate and schedule specific duration of each
major activity)
Activity Description People Duration Completion
Date
Complete Project
Plan
Overall scope of the projectandassociated
deliverables
CT 29 May
Needs
Assessment
Evaluationplanspecifics andclient
requirementsincludingevaluationgoals
CT/PS
/PM
1 week 5 June
Complete
EvaluationPlan
Outlinesdetails of evaluation(Instruments,
timeline, clientrequirements,expectations
(ANALYSISDOCUMENT DUE-5 JUNE)
CT/PS
/PM
1 week 5 June
Draft Level 1
instrument
Determine specificareasof focus. Provide
draft to PMfor review.
CT 1 week 12 June
Draft Level 2
Instruments
Create testsbasedon learningobjectives;
revise knowledgetestsbasedonSME
feedback
CT 2 weeks 19 June
Conductvalidity
and reliability
tests
Testsurveytool;pilotsurveywithBHP
staff;conductreview w/PM. Refine and
finalize level 1instrument
CT/PM 1 week 19 June
Conductvalidity
and reliability
tests
Conducttestreview w/stakeholders and
PM. UploadinstrumentintoOhioTRAIN
(LMS); pilottestwithBHPstaff;finalize
level 2instruments
(LEARNING DESIGN DOC DUE – 26 JUN)
CT/PM
/PS/BT
3 weeks 26 June
Gather level 2
data
Email participants trainingprerequisite
(pre-test) and gatherdataforlevel 2pre-
testbefore training
CT 1 week 26 June
Online seminar
completed
Trainingwill be overaseriesof days
(Assume conductedbetween20 JUN – 7
JUL)
Gather level 1and
level 2data
Upon completionof training: gatherlevel1
data viaSurveyMonkey andlevel2via
OhioTRAIN
CT 1 week 11 July
Draft level 3
instrument
Analyze existingperformancecriteria.
Revise anddevelopperformance checklist
basedon feedbackfrom clientandB-team
CT 3 weeks 11 July
Conductvalidity
and reliability
tests
Conductlevel 3instrumentreview with
client;pilotchecklist w/B-teamandPMfor
feedbackandrefinement.Refine and
finalize performancechecklist
(PI PLANDUE- 17 JULY)
CT/PM
/BT
2 weeks 17 July
Gather level 3
data
Sendperformance checklisttoLHD Health
Commissioners forcompletion
CT 2 weeks 22 July

5. Analyze and
interpret
Conductstatistical analysisof results;
create visuals;interpretwhetherthe
evaluationpurposeis met
(CAPSTONEPROJECT DUE – 6 AUG)
CT 2 weeks 5 August
Reportand make
recommendations
Create evaluationreportsanddocuments;
presentevaluationreportstostakeholders
CT/PS
/PM
1 week 5 August