Programme Evaluation in Open and Distance Learning

Slide 1: Programme Evaluation: Understanding the design (C) Sanjaya Mishra, 2007. 1

Slide 2: The Big Question… How to do programme evaluation? (C) Sanjaya Mishra, 2007. 2

Slide 3: “Evaluation is not to prove, but to improve ” 3 (C) Sanjaya Mishra, 2007.

Slide 4: Programme evaluation is not course evaluation… 4 (C) Sanjaya Mishra, 2007.

Slide 5: What is programme evaluation? A systematic gathering, analysis and reporting of data about a programme to assist decision-making. 5 (C) Sanjaya Mishra, 2007.

Slide 6: Programme evaluation is not end of event exercise… 6 (C) Sanjaya Mishra, 2007.

Slide 7: A Programme Evaluation Framework Focus Methods Tools Analysis Reporting Checklists Time Questionn- Pre-test Purpose Data Interpretation aires Data Colle- Stakeholders Collection Action Plan Interview ction Areas: COAT Plan Reporting schedules Analysis Qualitative Observation Quantitative sheets Sampling Questions Findings Decisions Blueprint Tools 7 (C) Sanjaya Mishra, 2007.

Slide 8: Example of Focus Purpose:  To improve the operation of the existing programme  To assess the impact of the programme  To maintain and assure quality  To decide on continuing with the programme  Any other? 8 (C) Sanjaya Mishra, 2007.

Slide 9: Example of Focus Stakeholders:  Students  Academic Counsellors  Faculty  Subject Matter Experts  Employers  Study Centre staff/ support staff  Society 9 (C) Sanjaya Mishra, 2007.

Slide 10: COAT Questions  Components: What are the components of the programme? Need to cover all…  Outcomes: What the programme is intended to achieve?  Activities: What activities are performed during the programme delivery? And how are they organized?  Target Groups: For whom the programme is designed, and what are their needs? 10 (C) Sanjaya Mishra, 2007.

Slide 11: Example of Focus Components:  Print materials  Support services  Academic counselling  Electronic resource support  Assignment and interactions  Project work supervision  Practical facilities  Post qualification placement  Any other? 11 (C) Sanjaya Mishra, 2007.

Slide 12: Example of Focus Outcomes: (eg. B. Ed.)  To increase the number of trained teachers in the country  To improve the quality of teaching- learning at school level  Any other? 12 (C) Sanjaya Mishra, 2007.

Slide 13: Example of Focus Activities:  Entrance Test  Admission  Supply of learning materials  Academic counselling  Practice teaching  Workshop  Assignments  Term-end evaluation 13 (C) Sanjaya Mishra, 2007.

Slide 14: Example of Focus Target Group:  In-service teachers with 2 years experience of teaching in secondary schools  Needs of the target group addressed? 14 (C) Sanjaya Mishra, 2007.

Slide 15: To conclude… Knowing is not enough; we must apply. Willing is not enough; we must do. -- Goethe (C) Sanjaya Mishra, 2007. 15

Slide 16: The Question still remains… 16 (C) Sanjaya Mishra, 2007.