13 project monitoring and evaluation


Published on

Published in: Education, Technology, Business
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

13 project monitoring and evaluation

  1. 1. PROJECT EVALUATION <ul><li>1. Definition </li></ul><ul><ul><li>2 aspects </li></ul></ul><ul><ul><li>1) Value Judgement of evaluated subject </li></ul></ul><ul><li>- A process of judgement of achievement </li></ul><ul><li> of evaluated subject </li></ul><ul><ul><ul><li>A judgement of outcome from activity </li></ul></ul></ul><ul><ul><ul><li>to achieve a certain target </li></ul></ul></ul><ul><li>- value determination of something </li></ul>
  2. 2. <ul><li>2) Information for decision </li></ul><ul><ul><ul><li>data collection and interpretation of data </li></ul></ul></ul><ul><ul><ul><li>A process of determination, procurement, </li></ul></ul></ul><ul><ul><ul><li>presentation of information that useful for </li></ul></ul></ul><ul><ul><ul><li>decision making </li></ul></ul></ul><ul><ul><ul><li>- Information gathering and use that </li></ul></ul></ul><ul><li>information for decision making of projects, </li></ul><ul><li>i.e., output, process of project. </li></ul>
  3. 3. 2. Evaluation Research - Base on research design - Data collection, analyze and process of data - Not aim to look for new theory - Aiming to test the application of new knowledge in management and action - Evaluation is a process of information formulation to judge something that leads to a decision making as systematically and with criteria.
  4. 4. <ul><ul><ul><li>- Evaluation is composed of : </li></ul></ul></ul><ul><ul><ul><ul><li>1) Measurement </li></ul></ul></ul></ul><ul><ul><ul><ul><li>2) Comparison </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Measurement is a process of determining </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>status and amount </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Comparision is a process of using the </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>results from measurement to judge </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>according to standard criteria. </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Compare between before and after </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>project. </li></ul></ul></ul></ul></ul><ul><li>- Judgement between actual and plan </li></ul>
  5. 5. 4. Evaluation Process Measurement Comparison Description Decision = Evaluation +
  6. 6. Purpose of Evaluation - Identify objective and use of information - Users of evaluation results, evaluation team, planners, implementation team, committee, executive, public, lawyer - The purpose of evaluation is to improve the project management and implementation
  7. 7. Good Evaluation must have the following information: - How much project objective is achieved. - Cost effective - Effects of the project What should be decided for the project
  8. 8. <ul><li>6 Functions of Evaluation </li></ul><ul><li> 1) Information function </li></ul><ul><li>- Feedback to improve project </li></ul><ul><li>2) Professional function </li></ul><ul><ul><ul><ul><ul><li>Increase understanding of project </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>objectives and process </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Success, failure, strength, weakness and </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>recommendation </li></ul></ul></ul></ul></ul><ul><li>3) Organizational Function </li></ul><ul><li>- Analysis of goal, purpose, strength, </li></ul><ul><li>weakness of organization structure </li></ul>
  9. 9. <ul><li>4) Political Function </li></ul><ul><ul><ul><ul><li>Encourage the participation and benefit </li></ul></ul></ul></ul><ul><ul><ul><ul><li>between planners and project managers </li></ul></ul></ul></ul><ul><li>5) Socio-Psychological Function </li></ul><ul><ul><ul><ul><li>build up the security of stakeholders </li></ul></ul></ul></ul><ul><li>6) Historical Function </li></ul><ul><li> - Record direction and lesson learn for future </li></ul><ul><li> project implementation </li></ul>
  10. 10. Scope and Coverage of Evaluation 1) Internal/External - Internal : by project staffs - External : increase the confidence of objectivity in evaluation process
  11. 11. <ul><li>2) Formation/Summative </li></ul><ul><ul><ul><li>Ongoing evaluation : information to improve </li></ul></ul></ul><ul><ul><ul><li>process </li></ul></ul></ul><ul><ul><ul><li>Post-evaluation : aims to sum thing up to look at </li></ul></ul></ul><ul><ul><ul><li>the achievement of project objectives </li></ul></ul></ul><ul><ul><ul><li>* Impact </li></ul></ul></ul><ul><ul><ul><li>* Cost-effectiveness </li></ul></ul></ul><ul><li>* Outcomes </li></ul><ul><li>3) Based on the unit of analysis </li></ul><ul><ul><ul><li>- participants </li></ul></ul></ul><ul><ul><ul><li>- project </li></ul></ul></ul><ul><li>- impact on community </li></ul>
  12. 12. <ul><li>3 Phases of evaluation </li></ul><ul><li>1) pre-implementation phase </li></ul><ul><ul><ul><li>- emphasizes on project design and development </li></ul></ul></ul><ul><ul><ul><li>- questions to be addresse </li></ul></ul></ul><ul><ul><ul><li>* target and objectives </li></ul></ul></ul><ul><li>* resources planing </li></ul><ul><li>* planning on activities and time frame </li></ul><ul><li>* required personnel </li></ul><ul><li>* report writing </li></ul>
  13. 13. <ul><li>2) During the programme implementation phase </li></ul><ul><ul><ul><li>- emphasizes on fact finding and effectiveness of project under various conditions </li></ul></ul></ul><ul><ul><ul><li>- trend analysis </li></ul></ul></ul><ul><ul><ul><ul><li> * process evaluation </li></ul></ul></ul></ul><ul><li> * experimental study </li></ul><ul><li>- questions: </li></ul><ul><li>* before fully implementation </li></ul><ul><li> * on-going implementation </li></ul>
  14. 14. <ul><li>11. Before fully implementation </li></ul><ul><ul><ul><li>- project verification V.S. sample of target group </li></ul></ul></ul><ul><ul><ul><li>- questions: </li></ul></ul></ul><ul><ul><ul><li>1) operation is according to the plan </li></ul></ul></ul><ul><li>2) quality of output is as expected </li></ul><ul><li>3) problems, recommendation for improvement </li></ul><ul><li>12. On-going evaluation </li></ul><ul><li>- check the output/outcome as plan </li></ul><ul><li>- questions : </li></ul><ul><ul><ul><ul><li>1) any changes according to objectives </li></ul></ul></ul></ul><ul><ul><ul><ul><li>2) should continue or terminate </li></ul></ul></ul></ul><ul><li>3) any improvement required </li></ul>
  15. 15. <ul><li>3) At the programme phase </li></ul><ul><li>- evaluate outcome, impact and outputs of project </li></ul><ul><li>- summative evaluation/cost-benefit analysis </li></ul><ul><li>- questions: </li></ul><ul><ul><ul><ul><li>1) innovation and dissemination </li></ul></ul></ul></ul><ul><ul><ul><ul><li>2) operation in the broad sense </li></ul></ul></ul></ul><ul><ul><ul><li>* reasonal benefit/cost </li></ul></ul></ul><ul><ul><ul><li>* should terminate, improve, correct or continue </li></ul></ul></ul><ul><li>* sustainable? </li></ul>
  16. 16. <ul><li>11 steps in evaluation planning </li></ul><ul><li>1) review project details </li></ul><ul><li>2) set up objectives and indicators </li></ul><ul><ul><ul><li>SMART </li></ul></ul></ul><ul><ul><ul><ul><li>S = Specific </li></ul></ul></ul></ul><ul><ul><ul><ul><li>M = Measurable </li></ul></ul></ul></ul><ul><ul><ul><ul><li>A = Achievable </li></ul></ul></ul></ul><ul><ul><ul><ul><li>R = Result Oriented </li></ul></ul></ul></ul><ul><li>T = Time bound </li></ul>
  17. 17. 3) Develop evaluation schedule, when and whom data is collected 4) Sampling – for large project 5) Type of data – look at objectives 6) Select and innovate instrument for data collection 7) Data collection plan 8) Data analysis plan – look at objectives 9) Cost estimation 10) Report and discloses information schedule 11) Scope of evaluation
  18. 18. <ul><li>Scope of evaluation depends on the </li></ul><ul><li>purpose of evaluation </li></ul><ul><li>- To improve process or system </li></ul><ul><ul><ul><ul><li>1) Emphasize on input and process </li></ul></ul></ul></ul><ul><ul><ul><li>- To look at outcomes and effects </li></ul></ul></ul><ul><li>1) Accomplishment and outcomes </li></ul>
  19. 19. Full Project Evaluation is composed of 5 aspects: - Context - Input - Process - Product - Effect/Impact - Which aspect depends on time frame of evaluation
  20. 20. <ul><li>Pre implementation evaluation </li></ul><ul><li>- For project planning : compose of </li></ul><ul><ul><ul><ul><li>1. Context evaluation </li></ul></ul></ul></ul><ul><li>- economic, social, politic </li></ul><ul><li>- problem and community’s needs </li></ul><ul><li>- target group </li></ul><ul><li> 2. Input evaluation </li></ul><ul><ul><ul><ul><ul><li>check adequacy of input and quality to be </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>used in project operation </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>appropriate technology </li></ul></ul></ul></ul></ul><ul><li>- a feasibility of work plan, financial plan </li></ul><ul><li> and staffs </li></ul>
  21. 21. Formatives/Ongoing Evaluation - Evaluate process - Is the operation progress? - Is input appropriate? - Does activity contribute to the achievement of objective? - How much is the outcome/effects? - What is the strength and weakness? - What is the obstacle? - The results will lead to the activity, process improvement
  22. 22. Post/Summative Evaluation - Look at product after project completion * whether objective is achievable, as well as target * whether the project is success according to the plan - Evaluate after a certain period of project completion * Impact evaluation * Output – outcomes * Both positive and negative impact - Evaluation models : CIPP, CIPOO, CIPPI
  23. 23. <ul><li>Evaluation Components : 2 aspects </li></ul><ul><li>1. Contents of evaluation </li></ul><ul><ul><ul><ul><li>scope or components </li></ul></ul></ul></ul><ul><ul><ul><ul><li>objectives </li></ul></ul></ul></ul><ul><ul><ul><ul><li>questions </li></ul></ul></ul></ul><ul><ul><ul><ul><li>indicators </li></ul></ul></ul></ul><ul><ul><ul><li>2. Methodology of evaluation </li></ul></ul></ul><ul><ul><ul><ul><li>evaluation design </li></ul></ul></ul></ul><ul><ul><ul><ul><li>source of data </li></ul></ul></ul></ul><ul><ul><ul><ul><li>data collection, mean of verification, </li></ul></ul></ul></ul><ul><ul><ul><ul><li>tools </li></ul></ul></ul></ul><ul><ul><ul><ul><li>data analysis </li></ul></ul></ul></ul><ul><li> - evaluation criteria </li></ul>
  24. 24. Essential components of evaluation design - purpose of evaluation - users - objectivity - time bound - resource available
  25. 25. <ul><li>Evaluation of policy, plan, project </li></ul><ul><ul><ul><li>- 6 aspects </li></ul></ul></ul><ul><ul><ul><ul><li>1) Effectiveness : want to know </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>policy, plan or project is success base on the </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>objectives </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>output, outcomes are according to objective, </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>target and expected results both </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>quantitative and qualitative </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><li>2) Efficiency : want to know </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>How much is resource used in </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>implementing the policy, plan or project? </li></ul></ul></ul></ul></ul><ul><li>- What and how much are the effects? </li></ul>
  26. 26. <ul><li>Efficiency of policy, plan or project is 2 folds </li></ul><ul><ul><ul><li>1) Technological efficiency </li></ul></ul></ul><ul><ul><ul><li>- Least cost to produce outputs or </li></ul></ul></ul><ul><ul><ul><li> outcomes </li></ul></ul></ul><ul><ul><ul><li>2) Economic efficiency </li></ul></ul></ul><ul><ul><ul><li>- The relationship between cost and </li></ul></ul></ul><ul><ul><ul><li> benefit </li></ul></ul></ul><ul><ul><ul><li>- Look at the increase of outcome per </li></ul></ul></ul><ul><ul><ul><li> unit of investment </li></ul></ul></ul><ul><ul><ul><li>- Decrease the cost per unit of outcome </li></ul></ul></ul><ul><ul><ul><li>- Look at the effort/input and output </li></ul></ul></ul><ul><li>- Measure in financial term </li></ul>
  27. 27. <ul><li>3) Sufficiency </li></ul><ul><ul><ul><li>- policy, plan, project meet the demand </li></ul></ul></ul><ul><ul><ul><li> of beneficiaries at the level of problem </li></ul></ul></ul><ul><ul><ul><li> alleviation </li></ul></ul></ul><ul><ul><ul><li>4) Equality </li></ul></ul></ul><ul><ul><ul><li>- who are the potential beneficiaries of </li></ul></ul></ul><ul><ul><ul><li> the project </li></ul></ul></ul><ul><ul><ul><li>5 ) Justice </li></ul></ul></ul><ul><ul><ul><li>- The project is determine for the people </li></ul></ul></ul><ul><ul><ul><li> in the society </li></ul></ul></ul><ul><ul><ul><li>6) Appropriateness </li></ul></ul></ul><ul><ul><ul><li>- Whether the activities, outputs are </li></ul></ul></ul><ul><ul><ul><li> complied to the need of beneficiaries </li></ul></ul></ul><ul><li>- Appropriate to area and time of project </li></ul><ul><li> implementation </li></ul>