An approach to the assessment of engineering projects using a simulation of project outcomes as part of the work.

1. Plan-Simulation-Report
Assessment
Dr Glenn Miles (g.miles@warwick.ac.uk)
WMG
University of Warwick
WMG/GM/PUB/2018/11

2. Presentation Summary
A coursework approach is presented in this document
designed primarily for project modules for engineering
degrees
It is comprised of two deliverables, one written at the start of
the project and one at the end
The approach has been designed
– to demonstrate (to the student) the links between planning and
outcomes for both projects and coursework
– provoke the student to develop the project by providing a
planning framework that binds deliverables and project work
together
– to provide the basis for assessed components including reflective
types
WMG/GM/PUB/2018/1 2

3. Deliverable Structure
Formative: Plan-Simulation Proposal
– Prior to project work
– Plan component is a conventional description of the project
in terms of aim and objectives, timescales and resourcing,
risk and mitigation
– Simulation component is a dry run of the summative report
conclusions section, assuming all objectives have been met
Summative: Project Report
– After project work completed
– A review of the completed project work
– A comparison of the realities of the project work with the
plan and with the simulation
WMG/GM/PUB/2018/1 3

4. Formative: Plan-Simulation Proposal
Plan
– centres around the objectives
• they lay out how the project will meet its aim in practice
• they provide the basis for the work to be completed upon which the summative report will be
based
– objectives are made of observations
• several observations are required to underwrite an objective
• observations are the bases for project activities and the precursors of the project conclusions
Simulation
– what if all observations were successfully completed and the objectives were all met?
• a set of conclusions can be written on this premise
• this simulates pulling the project aim through to the conclusion stage via the objectives
• AimObjectivesObservationsSimulation is a path to auditing the project plan for
opportunities to improve it
– the simulation also provides an exploration of other important questions
• how strong is the substantiation of the aim?
• how much risk remains after the project if the simulation is accurate?
• is the retained risk practicable?
• Is the project still successful if reality reaches (say) 95% of the simulation?
WMG/GM/PUB/2018/1 4

5. Formative: Assessment
Plan
– Testing that the project is SMART
• Has the plan been developed in light of the simulation?
– The project must meet individual and institutional requirements
• Student and tutor must be happy
• Sponsor and academic needs must also be met
– Typical questions that need answers
• Is the project challenging enough to warrant the academic award upon completion?
• Is the tutor confident that the student can complete the project?
• Does the project meet the other stakeholder requirements?
• Does the plan describe the project sufficiently and accurately?
Simulation
– The simulation is an extension of the project plan and provides a planning
diagnostic
• Will the project work match the project aim?
– The simulated conclusion section is written formally
• The student’s writing ability can be assessed and feedback given prior to the
authoring of the post-project deliverable report
WMG/GM/PUB/2018/1 5

6. Summative: Project Report
The project report is a comparative assessment of
two sets of conclusions:
– The conclusion set from the simulation
– The conclusion set from the actual work completed
during the project
The comparison provides:
– Planned versus actual performance
– Strength of support to conclusions from observations
Written in light of the feedback on style of
Simulation conclusions
– Was the feedback heeded?
WMG/GM/PUB/2018/1 6

7. Summative: Assessment
Design of Project Elements
– Plan
– Simulation
– Simulation-augmented Plan Update
Project Performance
– Work completed
– Time and resource control
– Risk management
Project Reporting
– Review of actual progress versus simulated progress
– Impact of simulation on project plan and also on project work
Documented Assessments
– Evidence of feedback in summative written work compared to formative
(simulation) written work
– Direct and indirect reflective statements
WMG/GM/PUB/2018/1 7

8. Verification and Validation Relationships
Simulation
Project PlanVALIDATION
Project
Reporting
Verification (Are we
building the right
thing?)
– If we follow the plan will
we meet the aim?
Validation (Are we
building the system
right?)
– Is the project work
substantiating the
objectives?
– Is the project on target?
WMG/GM/PUB/2018/1 8