This document provides guidance on evaluating extension program outcomes. It discusses identifying the appropriate sources of information, determining what information is needed, and collecting data in the right way. The key aspects are to ask the right people, for the right information, in the right way. The right people are those affected by the program, like participants. The right information addresses the program's objectives and expected outcomes. It should be collected using appropriate methods, balancing ideal data with available resources. Objectives and a model for program outcomes, the Bennett/Rockwell TOP Model, can guide the evaluation process.
MONITORING & EVALUATION OF EXTENSION PROGRAMMESAyush Mishra
MONITORING & EVALUATION OF EXTENSION PROGRAMMES. HIGHLIGHTS EXTENSION PROGRAMME PLANNING, MONITORING AND EVALUATION OF PROJECTS, STEPS IN PROGRAM PLANNING ETC.
Information may be time-sensitive. Subscribers should use the information contained at their own risk. Please check latest information with Dr. A by emailing bugdoctor@auburn.edu.
The rotavator is used for primary and secondary tillage to a depth of 6 inches, conserving soil moisture. It prepares land for sowing without overturning soil. It eradicates weeds and mixes manure or fertilizer into soil. The rotavator enhances soil fertility by mixing crop residues and is efficient for puddling in dry or wet soils. It saves time and fuel compared to other tillage implements.
1511, or the Act Amending the Organic Agriculture Act of 2010. Its goal is to make organic produce more accessible and affordable by having the government fully subsidize their international certification for a year.
This document discusses 8 common approaches to agricultural extension:
1. The general agriculture extension approach focuses on disseminating technologies to increase production and is centralized with priorities set nationally.
2. The commodity specialized approach concentrates on increasing production of a single crop through grouping related functions and requiring farmer cooperation.
3. The training and visit approach aims to increase crop production through rigorous training of agents and scheduled farmer visits to promote recommended practices.
4. The agricultural extension participatory approach gives farmer groups and local stakeholders more control and focuses on relevant, low-cost solutions through farmer participation.
This document provides an overview of micro irrigation systems. It defines micro irrigation as applying small quantities of water below or on the soil surface through emitters. The key types are drip irrigation, subsurface drip irrigation, bubbler irrigation, and mist/spray systems. Micro irrigation systems have main components including a control head, distribution pipes, emitters, and a flushing system. Proper design considers factors like soil type, crop needs, and water quality. Micro irrigation can improve water use efficiency but requires maintenance to prevent emitter clogging. Scheduling is based on crop water requirements and soil moisture monitoring.
INTRODUCTION
Tillage may be defined as the mechanical manipulation of soil for nurturing crops.
The objectives of soil tillage are:
To develop a desirable soil structure for a seedbed
To control weeds or remove unwanted crop plants.
To manage plant residues.
To minimize soil erosion by following such practices as contour tillage
To establish specific surface configurations for planting, irrigating, drainage, or harvesting operations.
To incorporate and mix fertilizers, manure, pesticides
MONITORING & EVALUATION OF EXTENSION PROGRAMMESAyush Mishra
MONITORING & EVALUATION OF EXTENSION PROGRAMMES. HIGHLIGHTS EXTENSION PROGRAMME PLANNING, MONITORING AND EVALUATION OF PROJECTS, STEPS IN PROGRAM PLANNING ETC.
Information may be time-sensitive. Subscribers should use the information contained at their own risk. Please check latest information with Dr. A by emailing bugdoctor@auburn.edu.
The rotavator is used for primary and secondary tillage to a depth of 6 inches, conserving soil moisture. It prepares land for sowing without overturning soil. It eradicates weeds and mixes manure or fertilizer into soil. The rotavator enhances soil fertility by mixing crop residues and is efficient for puddling in dry or wet soils. It saves time and fuel compared to other tillage implements.
1511, or the Act Amending the Organic Agriculture Act of 2010. Its goal is to make organic produce more accessible and affordable by having the government fully subsidize their international certification for a year.
This document discusses 8 common approaches to agricultural extension:
1. The general agriculture extension approach focuses on disseminating technologies to increase production and is centralized with priorities set nationally.
2. The commodity specialized approach concentrates on increasing production of a single crop through grouping related functions and requiring farmer cooperation.
3. The training and visit approach aims to increase crop production through rigorous training of agents and scheduled farmer visits to promote recommended practices.
4. The agricultural extension participatory approach gives farmer groups and local stakeholders more control and focuses on relevant, low-cost solutions through farmer participation.
This document provides an overview of micro irrigation systems. It defines micro irrigation as applying small quantities of water below or on the soil surface through emitters. The key types are drip irrigation, subsurface drip irrigation, bubbler irrigation, and mist/spray systems. Micro irrigation systems have main components including a control head, distribution pipes, emitters, and a flushing system. Proper design considers factors like soil type, crop needs, and water quality. Micro irrigation can improve water use efficiency but requires maintenance to prevent emitter clogging. Scheduling is based on crop water requirements and soil moisture monitoring.
INTRODUCTION
Tillage may be defined as the mechanical manipulation of soil for nurturing crops.
The objectives of soil tillage are:
To develop a desirable soil structure for a seedbed
To control weeds or remove unwanted crop plants.
To manage plant residues.
To minimize soil erosion by following such practices as contour tillage
To establish specific surface configurations for planting, irrigating, drainage, or harvesting operations.
To incorporate and mix fertilizers, manure, pesticides
This document discusses soil fertility in organic farming. It explains that organic farming relies on biological processes and avoiding chemicals to nourish soil and crops. Maintaining soil fertility organically includes techniques like conservative tillage, crop rotation, cover crops, organic manure and biofertilizers. These help retain nutrients and improve the soil ecosystem. While conventional farming uses chemicals and may provide higher short term yields, organic farming supports more sustainable soil health and biodiversity over the long run.
This document discusses various topics related to soil health including soil pollution, soil quality monitoring, soil health cards, remote sensing, GIS, soil-based plant nutrient information systems, and quality of irrigation water. It provides details on soil survey, soil pollution sources and effects, and applications of remote sensing and GIS in agriculture, forestry, land use mapping, and urban planning. Key points covered are soil formation, classification, variability, monitoring soil quality, and controlling soil pollution through sustainable practices. Remote sensing techniques and their use in various fields like agriculture, natural resource management, and infrastructure development are also summarized.
Produce Organic Concoctions and Extracts
The learner demonstrates an understanding of the basic concepts, underlying theories, and principles in the production of various concoction and extracts.
Pruning and training cucurbitaceous vegetable crops can improve their growth, yield and fruit quality. Research has found that pruning lateral branches on cucumber at 60cm from the base increased fruit number and yield. For bottle gourd, pruning all branches up to 45cm and pinching the vine at the 6th node improved flowering and yield. Training vines on structures like trellises also increased yields of crops like bitter gourd and pumpkin compared to no training. Different training systems like bower, T-trellis and umbrella produced higher yields than ground cultivation for various cucurbits.
Yield monitoring uses sensors and GPS data to collect georeferenced crop yield and characteristic data while harvesting. This allows farmers to create detailed yield maps of their fields to identify variable areas and optimize management practices. While yield monitors can provide accurate yield estimates if well-calibrated, challenges include sensor errors, moisture variations, and calibration biases. Yield monitoring is an important part of precision agriculture, enabling site-specific planting and variable input applications to improve efficiency and profitability.
Design, layout and installation of drip and fertigation in precision farmingDr. M. Kumaresan Hort.
This document provides information on the design, layout, installation and maintenance of drip and fertigation systems for precision farming. It discusses the components of drip irrigation systems including distribution networks, emitters/drippers, filters, fertilizer applicators and injection methods. It also outlines the installation process and maintenance procedures required to ensure efficient functioning of drip irrigation systems, including chemical treatments to prevent clogging.
The mouldboard plough has main components including a share, mouldboard, land side, frog, and tail piece. There are different types of shares and mouldboards. Plough accessories include a jointer to turn over a small furrow slice and a coulter to cut the furrow vertically ahead of the plough bottom. Other accessories are gauge wheels, land wheels, and furrow wheels. The mouldboard plough has adjustments for vertical and horizontal suction clearance as well as throat clearance. Plough size refers to the width of the soil cut.
This document discusses different types of fertilizer application methods. It describes various nitrogenous, phosphatic, and potassic fertilizers and their nutrient contents. It then summarizes different fertilizer application techniques including broadcasting, which applies fertilizers uniformly over the entire field; placement methods like drilling and side dressing, which apply fertilizers in bands close to seeds or plants; and foliar and fertigation application methods, which supply nutrients through leaves or irrigation water. The key methods support efficient nutrient utilization and minimize losses from leaching or fixation in soil.
This document outlines 14 principles of extension education. The principles include:
1) Prioritizing the needs and interests of local people over the agent's own interests.
2) Accounting for cultural differences between agents and farmers.
3) Engaging grassroots organizations familiar with local issues.
4) Understanding and utilizing indigenous knowledge systems.
5) Promoting learning through practical experience and participation.
The document discusses agricultural journalism, which deals with techniques of receiving, writing, editing and reporting agricultural news and information through various media like newspapers, radio, TV, etc. It highlights the importance of agricultural journalism in disseminating information to vast audiences. The need for agricultural journalism arises from the wide farmer to extension worker ratio. Sources of agricultural news include research stations, publications, farmer fields, universities and more. Principles of good writing include accuracy, brevity and clarity. The purpose of journalism is to inform, influence and entertain readers. In conclusion, the potential of agricultural journalism in taking over extension is noted, and generating trained professionals and upgrading skills is recommended.
Organic agriculture is a practice that does not use chemical fertilizers, pesticides, growth regulators or GMOs. It promotes biodiversity and the health of soil, plants, animals and people. Nutrient management in organic farming relies on practices like crop rotation, cover cropping, adding compost or manure, green manures, crop residues, and approved amendments to optimize soil health and nutrient supply. Maintaining soil organic matter and biological activity through these practices is the foundation of organic agriculture.
Characteristic of crop and farming system affecting irrigation management RamnathPotai
Ramnath Potai presents on characteristics of irrigation and farming systems affecting irrigation management. Key factors to consider when selecting an irrigation system include soil type, topography, water resources, crop selection, and economic conditions. Surface irrigation methods include basin, border and furrow irrigation. Other methods discussed are drip irrigation, sprinkler irrigation and automatic irrigation systems. Farming systems combine appropriate enterprises like crops, livestock, and forestry. Components like soil type, topography, water availability, crop and livestock selection, labor, and economic conditions interact with and affect irrigation management.
There are 8 common extension approaches used by organizations worldwide: general, commodity specialized, training and visit, participatory agricultural, project, farming systems development, cost sharing, and educational institution. Each has different characteristics, assumptions about farmers, purposes, planning/implementation strategies, resource requirements, implementation strategies, and measures of success. The general approach is top-down and centralized, while participatory and farming systems are more decentralized and involve farmers. Commodity specialized and training and visit approaches focus on increasing specific crop yields. The project approach concentrates resources on a small area for a limited time.
39 . Farmers field school ( learning objectives of ffs) A Series of Lectures...Mr.Allah Dad Khan
A Series of Lectures By Mr. Allah Dad Khan Provincial Director IPM ( Master Trainer ToT) KPK Ministry of Food Agriculture and Livestock (MINFAL) Islamabad Pakistan
Classification of Vegetable Crops
There are many numbers of Vegetables. Different parts are used for consumption. They are botanically different and their climatic and cultural requirements are different.
There are four Main Methods of Classification Based on:
1. Education Botanical relation
2. Based on Hardiness (Tolerance to low temp)
3. Parts Used for consumption
4. Methods of Culture
1. Botanical Classification:
This method of classification is based on botanical relationships of crops in responding cytology, morphology, taxonomy and cross ability. This is useful to breaf for crop improvement and seed producer for deciding isolation distance. The cuntroal requirements may vary ex. Solanaceous family includes potato, chili and brampal, There are same cultural requirements. At the same time cucurbitaceous have similar cultural requirements and common pests and diseases. Botanical name avoids infusion in name as common names are different but scientific names are common all over would. It gives information on class, family, genus, species, variety etc Ex. Solanaceous family, Potato, brinjal, chili, cucurbitaceous family: Melons, gourds. Not useful to grower. Thus botanical classification is useful to breeder, seed producer and to avoid confusion in common name.
2. Classification Based on Hardiness:
Vegetables are grouped as hardy or tender on the basis of tolerance to frost, tolerance to lower temperature. This gives information of season of growing i.e. summer or winter. Not useful to grower, since soil and climatic requirements are
RELATED POSTS
Jowar Shoot Fly & Jowar Stem Borer – Pests Of Jowar
Water Requirement And Irrigation Requirement
Nitrogen Cycle
Hardy
Semi Hardy
Tender
Asparagus
Beet Root
Okra
Cabbage
Carrot
Brinjal
Garlic
Cauliflower
Tomato / Chili
Onion
Palak
Beans
Peas
Potato
Cucurbit
Radish
Sweet Potato
Spinach
Sweet Potato
Spinach
Amaranthus
Turmp
3) Based on Parts Used for Consumption:
From roots to fruits different parts of vegetables are consumed. On that basis vegetables are classified.
Leafy Vegetable
Palak, Amaranthus Methi (leaves)
Root
Carrot, Radish, Turnip’, beet root
Fruit
Tomato, Biinjal; Cucurbit
Bulb
Onion, Garlic
Tuber
Potato, Sweet Potato
4) Based on Method of Culture:
In this method all those crops having similar cultural requirements are grouped together. They" are botanically different. System has practical utility for vegetable grower. In this method one can generalise cultivation practices for one group and thus avoid repetition individually for all crops. There are 11 classes. In some cases they are botanically also similar Ex. cucurbits. On excises for convenience they are grouped as under.
I.
Perennial Vegetable
Asparagus, cocinia (Tondali), Parwal, Drumstick
2
Greens
Spinach
3
Salad Crops
Lettuce, celery
4
Cole Crops
Cabbage, Cauliflower
5
Bulb Crops
Onion, Garlic
6
Root Crops
Carrot / radish, turnip
7
Tuber
a) Potato
This document discusses rural agricultural work experience and extension teaching methods. It defines extension teaching methods as devices used to create communication between instructors and learners. Extension methods are classified as individual contact methods, group contact methods, and mass contact methods. Individual methods include farm visits and demonstrations. Group methods include result demonstrations, method demonstrations, and group discussions. Mass methods include publications, newspapers, radio, television, and campaigns. The document provides details on objectives, advantages, and limitations of various extension teaching methods.
The Perspectives of Agricultural Extension” aims at providing AICM students with an understanding of the perspectives of agricultural extension. Specifically, the module aims to:
Enable student understanding of agricultural extension perspectives in the current changing scenario of agriculture
Enhance students’ understanding of Information and Communication Technology and Management within the existing agricultural extension system and the changes that need to be considered
Produce graduates who understand the importance of agricultural information communication management and are self-sufficient in applying it in their agricultural extension practice
Produce graduates who will strengthen the capacity of the extension system in the area of Information and Communication Management (ICM)so as to provide services in technology diffusion and uptake
The course module is divided into thirteen topics in total.
Each topic in the module consists of an introduction, objectives, outcomes and summary.
Assessment activities in the form of assignments, field work, cases studies and reflections are also found under all the topics except topic five. These activities will help you in your attempt to learn, critically analyse and understand the contents of the topics.
Each topic in the module consists of an introduction, objectives, outcomes and summary. Assessment activities in the form of assignments, field work, cases studies and reflections are also found under all the topics except topic five. These activities will help you in your attempt to learn, critically analyse and understand the contents of the topics.
Off-season vegetable production involves growing vegetables outside of their normal season to supply the market during periods of low availability. This is done by adjusting planting times, selecting improved varieties suited to different conditions, and creating controlled environments using structures like plastic tunnels and greenhouses. Off-season production benefits farmers through better land use, higher profits from higher prices during lean seasons, and year-round employment and income. It also ensures consumers have access to fresh vegetables year-round and increases overall vegetable production and supply.
The document discusses the goals and strategies of various Five Year Plans in India related to health and sanitation. Key goals included eradicating diseases, increasing access to primary healthcare, population control, and developing health resources. Plans aimed to provide safe drinking water, control communicable diseases, improve nutrition, and promote indigenous medicine. Targets included reducing infant and maternal mortality, increasing literacy, and achieving universal vaccination and family planning coverage.
This document discusses soil fertility in organic farming. It explains that organic farming relies on biological processes and avoiding chemicals to nourish soil and crops. Maintaining soil fertility organically includes techniques like conservative tillage, crop rotation, cover crops, organic manure and biofertilizers. These help retain nutrients and improve the soil ecosystem. While conventional farming uses chemicals and may provide higher short term yields, organic farming supports more sustainable soil health and biodiversity over the long run.
This document discusses various topics related to soil health including soil pollution, soil quality monitoring, soil health cards, remote sensing, GIS, soil-based plant nutrient information systems, and quality of irrigation water. It provides details on soil survey, soil pollution sources and effects, and applications of remote sensing and GIS in agriculture, forestry, land use mapping, and urban planning. Key points covered are soil formation, classification, variability, monitoring soil quality, and controlling soil pollution through sustainable practices. Remote sensing techniques and their use in various fields like agriculture, natural resource management, and infrastructure development are also summarized.
Produce Organic Concoctions and Extracts
The learner demonstrates an understanding of the basic concepts, underlying theories, and principles in the production of various concoction and extracts.
Pruning and training cucurbitaceous vegetable crops can improve their growth, yield and fruit quality. Research has found that pruning lateral branches on cucumber at 60cm from the base increased fruit number and yield. For bottle gourd, pruning all branches up to 45cm and pinching the vine at the 6th node improved flowering and yield. Training vines on structures like trellises also increased yields of crops like bitter gourd and pumpkin compared to no training. Different training systems like bower, T-trellis and umbrella produced higher yields than ground cultivation for various cucurbits.
Yield monitoring uses sensors and GPS data to collect georeferenced crop yield and characteristic data while harvesting. This allows farmers to create detailed yield maps of their fields to identify variable areas and optimize management practices. While yield monitors can provide accurate yield estimates if well-calibrated, challenges include sensor errors, moisture variations, and calibration biases. Yield monitoring is an important part of precision agriculture, enabling site-specific planting and variable input applications to improve efficiency and profitability.
Design, layout and installation of drip and fertigation in precision farmingDr. M. Kumaresan Hort.
This document provides information on the design, layout, installation and maintenance of drip and fertigation systems for precision farming. It discusses the components of drip irrigation systems including distribution networks, emitters/drippers, filters, fertilizer applicators and injection methods. It also outlines the installation process and maintenance procedures required to ensure efficient functioning of drip irrigation systems, including chemical treatments to prevent clogging.
The mouldboard plough has main components including a share, mouldboard, land side, frog, and tail piece. There are different types of shares and mouldboards. Plough accessories include a jointer to turn over a small furrow slice and a coulter to cut the furrow vertically ahead of the plough bottom. Other accessories are gauge wheels, land wheels, and furrow wheels. The mouldboard plough has adjustments for vertical and horizontal suction clearance as well as throat clearance. Plough size refers to the width of the soil cut.
This document discusses different types of fertilizer application methods. It describes various nitrogenous, phosphatic, and potassic fertilizers and their nutrient contents. It then summarizes different fertilizer application techniques including broadcasting, which applies fertilizers uniformly over the entire field; placement methods like drilling and side dressing, which apply fertilizers in bands close to seeds or plants; and foliar and fertigation application methods, which supply nutrients through leaves or irrigation water. The key methods support efficient nutrient utilization and minimize losses from leaching or fixation in soil.
This document outlines 14 principles of extension education. The principles include:
1) Prioritizing the needs and interests of local people over the agent's own interests.
2) Accounting for cultural differences between agents and farmers.
3) Engaging grassroots organizations familiar with local issues.
4) Understanding and utilizing indigenous knowledge systems.
5) Promoting learning through practical experience and participation.
The document discusses agricultural journalism, which deals with techniques of receiving, writing, editing and reporting agricultural news and information through various media like newspapers, radio, TV, etc. It highlights the importance of agricultural journalism in disseminating information to vast audiences. The need for agricultural journalism arises from the wide farmer to extension worker ratio. Sources of agricultural news include research stations, publications, farmer fields, universities and more. Principles of good writing include accuracy, brevity and clarity. The purpose of journalism is to inform, influence and entertain readers. In conclusion, the potential of agricultural journalism in taking over extension is noted, and generating trained professionals and upgrading skills is recommended.
Organic agriculture is a practice that does not use chemical fertilizers, pesticides, growth regulators or GMOs. It promotes biodiversity and the health of soil, plants, animals and people. Nutrient management in organic farming relies on practices like crop rotation, cover cropping, adding compost or manure, green manures, crop residues, and approved amendments to optimize soil health and nutrient supply. Maintaining soil organic matter and biological activity through these practices is the foundation of organic agriculture.
Characteristic of crop and farming system affecting irrigation management RamnathPotai
Ramnath Potai presents on characteristics of irrigation and farming systems affecting irrigation management. Key factors to consider when selecting an irrigation system include soil type, topography, water resources, crop selection, and economic conditions. Surface irrigation methods include basin, border and furrow irrigation. Other methods discussed are drip irrigation, sprinkler irrigation and automatic irrigation systems. Farming systems combine appropriate enterprises like crops, livestock, and forestry. Components like soil type, topography, water availability, crop and livestock selection, labor, and economic conditions interact with and affect irrigation management.
There are 8 common extension approaches used by organizations worldwide: general, commodity specialized, training and visit, participatory agricultural, project, farming systems development, cost sharing, and educational institution. Each has different characteristics, assumptions about farmers, purposes, planning/implementation strategies, resource requirements, implementation strategies, and measures of success. The general approach is top-down and centralized, while participatory and farming systems are more decentralized and involve farmers. Commodity specialized and training and visit approaches focus on increasing specific crop yields. The project approach concentrates resources on a small area for a limited time.
39 . Farmers field school ( learning objectives of ffs) A Series of Lectures...Mr.Allah Dad Khan
A Series of Lectures By Mr. Allah Dad Khan Provincial Director IPM ( Master Trainer ToT) KPK Ministry of Food Agriculture and Livestock (MINFAL) Islamabad Pakistan
Classification of Vegetable Crops
There are many numbers of Vegetables. Different parts are used for consumption. They are botanically different and their climatic and cultural requirements are different.
There are four Main Methods of Classification Based on:
1. Education Botanical relation
2. Based on Hardiness (Tolerance to low temp)
3. Parts Used for consumption
4. Methods of Culture
1. Botanical Classification:
This method of classification is based on botanical relationships of crops in responding cytology, morphology, taxonomy and cross ability. This is useful to breaf for crop improvement and seed producer for deciding isolation distance. The cuntroal requirements may vary ex. Solanaceous family includes potato, chili and brampal, There are same cultural requirements. At the same time cucurbitaceous have similar cultural requirements and common pests and diseases. Botanical name avoids infusion in name as common names are different but scientific names are common all over would. It gives information on class, family, genus, species, variety etc Ex. Solanaceous family, Potato, brinjal, chili, cucurbitaceous family: Melons, gourds. Not useful to grower. Thus botanical classification is useful to breeder, seed producer and to avoid confusion in common name.
2. Classification Based on Hardiness:
Vegetables are grouped as hardy or tender on the basis of tolerance to frost, tolerance to lower temperature. This gives information of season of growing i.e. summer or winter. Not useful to grower, since soil and climatic requirements are
RELATED POSTS
Jowar Shoot Fly & Jowar Stem Borer – Pests Of Jowar
Water Requirement And Irrigation Requirement
Nitrogen Cycle
Hardy
Semi Hardy
Tender
Asparagus
Beet Root
Okra
Cabbage
Carrot
Brinjal
Garlic
Cauliflower
Tomato / Chili
Onion
Palak
Beans
Peas
Potato
Cucurbit
Radish
Sweet Potato
Spinach
Sweet Potato
Spinach
Amaranthus
Turmp
3) Based on Parts Used for Consumption:
From roots to fruits different parts of vegetables are consumed. On that basis vegetables are classified.
Leafy Vegetable
Palak, Amaranthus Methi (leaves)
Root
Carrot, Radish, Turnip’, beet root
Fruit
Tomato, Biinjal; Cucurbit
Bulb
Onion, Garlic
Tuber
Potato, Sweet Potato
4) Based on Method of Culture:
In this method all those crops having similar cultural requirements are grouped together. They" are botanically different. System has practical utility for vegetable grower. In this method one can generalise cultivation practices for one group and thus avoid repetition individually for all crops. There are 11 classes. In some cases they are botanically also similar Ex. cucurbits. On excises for convenience they are grouped as under.
I.
Perennial Vegetable
Asparagus, cocinia (Tondali), Parwal, Drumstick
2
Greens
Spinach
3
Salad Crops
Lettuce, celery
4
Cole Crops
Cabbage, Cauliflower
5
Bulb Crops
Onion, Garlic
6
Root Crops
Carrot / radish, turnip
7
Tuber
a) Potato
This document discusses rural agricultural work experience and extension teaching methods. It defines extension teaching methods as devices used to create communication between instructors and learners. Extension methods are classified as individual contact methods, group contact methods, and mass contact methods. Individual methods include farm visits and demonstrations. Group methods include result demonstrations, method demonstrations, and group discussions. Mass methods include publications, newspapers, radio, television, and campaigns. The document provides details on objectives, advantages, and limitations of various extension teaching methods.
The Perspectives of Agricultural Extension” aims at providing AICM students with an understanding of the perspectives of agricultural extension. Specifically, the module aims to:
Enable student understanding of agricultural extension perspectives in the current changing scenario of agriculture
Enhance students’ understanding of Information and Communication Technology and Management within the existing agricultural extension system and the changes that need to be considered
Produce graduates who understand the importance of agricultural information communication management and are self-sufficient in applying it in their agricultural extension practice
Produce graduates who will strengthen the capacity of the extension system in the area of Information and Communication Management (ICM)so as to provide services in technology diffusion and uptake
The course module is divided into thirteen topics in total.
Each topic in the module consists of an introduction, objectives, outcomes and summary.
Assessment activities in the form of assignments, field work, cases studies and reflections are also found under all the topics except topic five. These activities will help you in your attempt to learn, critically analyse and understand the contents of the topics.
Each topic in the module consists of an introduction, objectives, outcomes and summary. Assessment activities in the form of assignments, field work, cases studies and reflections are also found under all the topics except topic five. These activities will help you in your attempt to learn, critically analyse and understand the contents of the topics.
Off-season vegetable production involves growing vegetables outside of their normal season to supply the market during periods of low availability. This is done by adjusting planting times, selecting improved varieties suited to different conditions, and creating controlled environments using structures like plastic tunnels and greenhouses. Off-season production benefits farmers through better land use, higher profits from higher prices during lean seasons, and year-round employment and income. It also ensures consumers have access to fresh vegetables year-round and increases overall vegetable production and supply.
The document discusses the goals and strategies of various Five Year Plans in India related to health and sanitation. Key goals included eradicating diseases, increasing access to primary healthcare, population control, and developing health resources. Plans aimed to provide safe drinking water, control communicable diseases, improve nutrition, and promote indigenous medicine. Targets included reducing infant and maternal mortality, increasing literacy, and achieving universal vaccination and family planning coverage.
Evaluating outcomes in Social Work Educationforeman
This document discusses evaluating the outcomes of social work education programs. It begins by noting the lack of rigorous evaluations in this area, with most studies only evaluating learner satisfaction rather than actual learning outcomes. It then discusses different models of classifying learning outcomes, including Kirkpatrick's four levels of outcomes: reactions, learning, behavior change, and results. The document emphasizes the importance of evaluating higher levels of outcomes like behavior change and benefits to service users and carers, rather than just focusing on learner satisfaction. It also notes that when asked, service users and carers stress the importance of evaluating changes in attitudes, knowledge and skills in professionals rather than just benefits to themselves. The document aims to stimulate discussion on how to better evaluate the outcomes of
The document discusses intended learning outcomes and student assessment. It defines intended learning outcomes as statements describing what students know, understand and can do as a result of their learning experiences. It provides examples of learning outcomes related to communication skills, research skills and ethics. It also discusses how to write learning outcomes using verbs that describe observable and measurable behaviors and aligning outcomes with courses, programs and institutions.
Predicting outcomes involves using clues from pictures or stories as well as past experiences to determine what is most likely to happen next. Some key aspects of predicting outcomes discussed in the document are:
1) Looking at pictures or events and using clues within them to anticipate future events
2) Drawing on similar past experiences to help guide predictions
3) Integrating available information to conclude the most probable outcome.
This document contains a detailed lesson plan for an English lesson for second grade students. The objectives are for students to be able to predict outcomes in different situations and stories. The lesson plan outlines teacher and student activities including introducing the concept of predicting outcomes, reading a story about a girl buying eggs at the store, having students predict what will happen next in various situations, and assessing their understanding through questions and activities. Students work independently and in groups to practice predicting outcomes in different scenarios.
Innovation Network's own workbook on evaluation planning. Can be used alone or in conjunction with the Evaluation Plan Builder at the Point K Learning Center.
The document discusses incorporating impact assessments into the Research Excellence Framework (REF) evaluation process. It summarizes the results of an impact pilot project that tested assessing the societal and economic impacts of research through expert review of case studies. The pilot found it is possible to assess research impacts and that a generic approach can work across disciplines, with refinements needed. Sub-panels provided feedback that bibliometrics could help inform peer review but not be used formulaically due to coverage differences across fields. Next steps include procuring citation data and a July decision on bibliometrics in the REF.
The document discusses incorporating impact assessments into the Research Excellence Framework (REF) evaluation process. It summarizes the results of an impact pilot project that tested assessing the societal and economic impacts of research through expert review of case studies. The pilot found it is possible to assess research impacts and that a generic approach can work across disciplines, with refinements needed. Sub-panels provided feedback that bibliometrics could help inform peer review but not be used formulaically due to coverage differences across fields. Next steps include procuring citation data and a July decision on bibliometrics in the REF.
17- Program Evaluation a beginner’s guide.pdfAnshuman834549
This document provides an overview of program evaluation. It discusses that the key goal of program evaluation is to determine whether a program works and how it can be improved. It covers important aspects of planning an evaluation such as determining the evaluation question, developing a logic model or theory of change, and choosing an appropriate design such as experimental, quasi-experimental, or case study. Experimental design using random assignment to treatment and control groups can provide clear evidence of a program's impact but has limitations. The document discusses various methods for data collection and analysis to evaluate a program's outcomes and processes.
This document provides a toolkit for conducting a comprehensive community needs assessment. It acknowledges that many agencies conduct needs assessments primarily for funding purposes. The toolkit aims to help agencies conduct a single, integrated needs assessment to better coordinate services, direct change, and set the framework for more innovative service delivery. It covers data collection from statistical sources, surveys, focus groups, interviews and partners. It also provides guidance on analyzing information, prioritizing issues, and using the needs assessment to inform strategic planning through logic models. The overall goal is for the assessment to help agencies understand and address the underlying causes of poverty in their community.
Health Coaching Motivational Interviewing Proficiency Assessmentmkgreco
Overview and validation study of the Health Coaching Performance (HCPA) assessment and reporting tool and system for benchmarking the proficiency of health care professionals in motivational interviewing and evidence-based health coaching.
This document provides guidance on developing an effective evaluation plan. It discusses engaging stakeholders, describing the program, focusing the evaluation, gathering credible evidence, drawing conclusions, and disseminating results. The workbook was created by the CDC's Office on Smoking and Health and Division of Nutrition, Physical Activity, and Obesity to offer tools for program evaluators to build evaluation capacity. It applies CDC's Framework for Program Evaluation in Public Health, which lays out six key steps for conducting an evaluation. The workbook includes exercises, worksheets, and examples to facilitate developing a comprehensive evaluation plan.
Paone_Business Planning for Dementia Programs_Toolkit FINALDeborah Paone
This document provides a toolkit for developing a business plan for dementia programs offered by nonprofit and government agencies. It covers key components of a business plan including defining the program's purpose and business model, selecting program components and operations, developing funding strategies, creating a marketing plan, and conducting an evaluation. The toolkit offers questions to consider, case examples, and additional resources for each section to help readers develop a comprehensive business plan tailored to their specific dementia program.
The document summarizes the results of the 2014 Massachusetts Worksite Health Improvement Survey. It finds that chronic diseases pose a large burden in Massachusetts and are costly for employers. The survey assessed 621 Massachusetts worksites on their health promotion policies and programs. It provides suggestions in 7 areas for worksites to improve employee health, such as having visible leadership commitment, conducting needs assessments, and evaluating programs with data. The report aims to help worksites customize wellness strategies for their specific workforces and industries.
The document summarizes the discussions and action items from a meeting to plan the Smooth Transition to Employability and Professional Skills from School & VET (STEPS) strategic partnership project. Key discussion points and tasks included:
1) Developing rules and tools for a student competition on career pathways in the EU with deadlines in April.
2) Creating career guidance training materials to incorporate into curricula, with each partner assigned tasks.
3) Establishing a framework to compile best practices in career guidance from each country.
4) Designing an online info point for the project website with examples like CVs and Europass.
5) Creating monitoring indicators to evaluate the project.
The document provides guidance on developing goals and desired outcomes for teen pregnancy prevention programs using a Behavior-Determinants-Interventions (BDI) logic model. It explains that the BDI model clearly links a program's health goal, behaviors to be changed, determinants that influence behaviors, and interventions. It then outlines the 4-step process to complete the BDI model: 1) select a health goal, 2) identify behaviors affecting the goal, 3) select determinants linked to the behaviors, and 4) develop measurable outcome statements. The fictional FYN program then works through this process to create a BDI logic model for their teen pregnancy prevention program with the goal of reducing teen pregnancy rates.
Dissertation on Social Media Advertising Practices in the Fast Fashion Indust...Amresh Pratap Yadav
This document provides a literature review on social media advertising strategies employed by fast fashion brands like H&M and Zara and their impact on customer purchase intentions and brand loyalty. It identifies several theories that explain how social media advertising can influence consumer behavior, such as the 4C framework and Hierarchy of Effects model. Popular social media strategies used by fast fashion brands, including display ads, photo and video posting, are also examined. While social media advertising is found to be generally more effective than traditional methods, more research is still needed to understand its effects according to different theories. The review informs the study's methodology to analyze the link between H&M's and Zara's social media strategies and customer outcomes in the UK.
SIRENE: Social Intelligence for Energy Efficient ecosystemGiorgia Zunino
This document proposes a project called Sirene that aims to develop social intelligence for energy efficient ecosystems. It is a Research and Innovation Action that addresses the H2020 call topic EE11 2014/2015 on new ICT-based solutions for energy efficiency. The consortium involves 9 partners from 5 European countries. The objectives are to develop predictive analytics for energy consumption optimization, characterize energy demand through social networks, and establish business models for energy cost saving. The approach involves validating the techniques through pilots and use cases. The project is expected to have impacts like improving energy efficiency and innovation capacity in Europe while aligning with European energy policy and social goals.
APPENDIX AAppraisal GuideRecommendations of a Clinical Practic.docxrobert345678
APPENDIX A
Appraisal Guide
Recommendations of a Clinical Practice Guideline
Citation:
_________________________________________________________________________
_________________________________________________________________________
_________________________________________________________________________
Synopsis
What group or groups produced the guideline?
What does the guideline address? Clinical questions, conditions, interventions?
What population of patients does the guideline address?
Did the panel use existing SRs or did it conduct its own?
What clinical outcomes was the guideline designed to achieve?
What are the main recommendations?
What system was used to grade the recommendations?
Credibility
Was the panel made up of people with the necessary expertise? Yes No Not clear
Are the goals for developing the guideline explicit and clear? Yes No Not clear
*Does the guideline production process include all the widely
recognized steps? Yes No Not clear
*Were the SRs used of high quality? Yes No Not clear
Are differences in evidence for subpopulations recognized? Yes No Not clear
*Is the evidence supporting each
recommendation graded or stated as adequate to strong? Yes No Not clear
Is the guideline current? (based on
issue date and date of most recent evidence included) Yes No Not clear
Are the recommendations credible? Yes All Yes Some No
Clinical Significance
Are essential elements of any
recommended action or intervention clearly stated? Yes No Not clear
*Is the magnitude of benefit associated
with each recommendation clinically important? Yes No Not clear
*Is the panel’s certainty or confidence
in each recommendation clear? Yes No Not clear
Were patient concerns, values, and risks addressed? Yes No Not clear
Were downsides or costs of each recommendation addressed? Yes No Not clear
Was the guideline reviewed by
outside experts and a member of
the public or field tested? Yes No Not clear
Are the recommendations
clinically significant? Yes All Yes Some No
Applicability
Does the guideline address a problem,
weakness, or decision we are examining in our setting? Yes No
Did the research evidence involve
patients similar to ours, and was the
setting similar to ours? Yes No Some
What changes, additions, training, or
purchases would be needed to
implement and sustain a clinical
protocol based on these conclusions? Specify.
____________________________________________________________________________
____________________________________________________________________________
*Is what we will have to do to implement the new protocol realistically achievable by us (resources, capability, commitment)? Yes No Not clear
Which departments and/or providers will be affected by a change? Specify.
__________________________________________________.
This document provides an overview of various tools, methods, and approaches for monitoring and evaluation (M&E) used by the World Bank. It discusses performance indicators, the logical framework approach, theory-based evaluation, formal surveys, rapid appraisal methods, participatory methods, public expenditure tracking surveys, cost-benefit and cost-effectiveness analysis, and impact evaluation. For each method, it provides a brief description, intended uses, advantages and disadvantages, typical costs and skills required, and references for more information. The document aims to strengthen understanding of M&E and clarify what activities and processes are involved.
This document provides an overview of various tools, methods, and approaches for monitoring and evaluation (M&E) used by the World Bank. It discusses performance indicators, the logical framework approach, theory-based evaluation, formal surveys, rapid appraisal methods, participatory methods, public expenditure tracking surveys, cost-benefit and cost-effectiveness analysis, and impact evaluation. For each method, it provides a brief description, intended uses, advantages and disadvantages, typical costs and skills required, and references for more information. The document aims to strengthen understanding of M&E and clarify what activities and processes are involved.
How to Improve Time to Market w Existing ResourcesLiberteks
This document summarizes the findings of a research report on improving time to market with existing resources in product development organizations. It finds that while most organizations recognize the need to improve resource management and capacity planning processes, only a third have achieved higher maturity levels. Key opportunities include improving visibility into demand and capacity, optimizing resource usage, and reducing risks like missed market windows. The report provides recommendations for organizations to prioritize process improvements, leverage historical data, and invest in enterprise software to help optimize resources and better manage capacity.
This document provides 49 action steps across 10 categories to help organizations achieve 110% of their goals. It was developed over 5 years working with hundreds of companies. The action steps are designed to help assess an organization's strategic alignment, operational definitions, management style, metrics, defect identification, cost of poor quality, cultural readiness for change, willingness to deploy improvements, and ability to identify opportunities. The document can help identify areas that may be preventing an organization from achieving its goals and better connecting strategy to execution.
To ensure the success of a program evaluation, a social worker mmarilynnhoare
To ensure the success of a program evaluation, a social worker must generate a specific detailed plan. That plan should describe the goal of the evaluation, the information needed, and the methods and analysis to be used. In addition, the plan should identify and address the concerns of stakeholders. A social worker should present information about the plan in a manner that the stakeholders can understand. This will help the social worker receive the support necessary for a successful evaluation.
To prepare for this Assignment, identify a program evaluation you would like to conduct for a program with which you are familiar. Consider the details of the evaluation, including the purpose, specific questions to address, and type of information to collect. Then, consider the stakeholders that would be involved in approving that evaluation. Review the resources for samples of program evaluations.
Submit
the following:
A 1-page stakeholder analysis that identifies the stakeholders, their role in the agency and any concerns that they might have about the proposed program evaluation
A 2- to 3-page draft of the program evaluation plan to submit to the stakeholders that:
Identifies the purpose of the evaluation
Describes the questions that will be addressed and the type of information that will be collected
Addresses the concerns of the stakeholders that you identified in your Stakeholder Analysis
...
Monitoring and evaluation toolkit - Conférence de la 2e édition du Cours international « Atelier Paludisme » - TUSEO Luciano - World Health Organization / Roll Back Malaria - maloms@iris.mg
Similar to Evaluating Extension Programe Outcomes (20)
This document provides an overview of the Farmer Field School (FFS) methodology. Some key points:
10
1. FFS was developed by FAO in Southeast Asia to empower smallholder farmers through experiential learning. Farmers conduct field experiments and make their own decisions, guided by facilitators rather than instructions.
2. The approach has since spread globally and been adapted for different crops, soils, livestock, and issues. Principles include farmer-led experimentation and observation, regular group meetings, and facilitators who provide support rather than lectures.
3. Implementation follows several steps - groundwork, facilitator training, regular FFS meetings where farmers collect data, evaluate trials, and
The EU provides over €40 billion annually in subsidies for its agricultural sector, including export refunds (subsidies) for major agricultural and dairy products. These export refunds allow the EU to export goods to Africa more cheaply than local African producers. This negatively impacts trade balances and smallholder farmers in Africa. Eliminating EU export refunds could increase global food prices slightly but would significantly benefit African countries that rely on agricultural exports by improving their trade balances and fiscal stability. However, the impact would be greater if combined with removal of tariffs and domestic support as well.
This document provides guidance on conducting situational analyses and setting program priorities for University of Wisconsin Extension offices. It discusses engaging community stakeholders throughout the situational analysis to build understanding and ownership. Case examples and tools are provided to aid in gathering and analyzing data on community needs, assets, and concerns. The priority setting process should consider available resources and involve the county oversight committee, as required by law, to identify priorities the Extension office will address. Communicating results builds further involvement.
This document provides an overview and guide for the course AEM 301 "Introduction to Agricultural Extension and Rural Sociology". The course is a one semester, two credit unit course for students of Agricultural Extension Management. It will cover 15 units across 3 modules. The course aims to stimulate interest in agricultural extension and rural sociology, outline their contributions to development, and recognize the importance of rural development. Upon completing the course, students will be able to define key concepts, discuss theories and strategies, and analyze institutions related to agricultural extension and rural sociology. Assessment will consist of tutor-marked assignments making up 30% of the grade and a final exam constituting the remaining 70%.
This document discusses smallholder cassava production in Southeast Asia. It notes that cassava is traditionally grown as a subsistence crop by smallholder farmers with little to no inputs. However, cassava production can lead to soil depletion and erosion over time if not managed properly. The document discusses several agronomic practices and soil conservation techniques that have been shown to reduce erosion and maintain soil fertility while increasing cassava yields, including intercropping, contour hedgerows, mulching, and fertilizer application.
How to Make a Field Mandatory in Odoo 17Celine George
In Odoo, making a field required can be done through both Python code and XML views. When you set the required attribute to True in Python code, it makes the field required across all views where it's used. Conversely, when you set the required attribute in XML views, it makes the field required only in the context of that particular view.
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxEduSkills OECD
Iván Bornacelly, Policy Analyst at the OECD Centre for Skills, OECD, presents at the webinar 'Tackling job market gaps with a skills-first approach' on 12 June 2024
Temple of Asclepius in Thrace. Excavation resultsKrassimira Luka
The temple and the sanctuary around were dedicated to Asklepios Zmidrenus. This name has been known since 1875 when an inscription dedicated to him was discovered in Rome. The inscription is dated in 227 AD and was left by soldiers originating from the city of Philippopolis (modern Plovdiv).
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPRAHUL
This Dissertation explores the particular circumstances of Mirzapur, a region located in the
core of India. Mirzapur, with its varied terrains and abundant biodiversity, offers an optimal
environment for investigating the changes in vegetation cover dynamics. Our study utilizes
advanced technologies such as GIS (Geographic Information Systems) and Remote sensing to
analyze the transformations that have taken place over the course of a decade.
The complex relationship between human activities and the environment has been the focus
of extensive research and worry. As the global community grapples with swift urbanization,
population expansion, and economic progress, the effects on natural ecosystems are becoming
more evident. A crucial element of this impact is the alteration of vegetation cover, which plays a
significant role in maintaining the ecological equilibrium of our planet.Land serves as the foundation for all human activities and provides the necessary materials for
these activities. As the most crucial natural resource, its utilization by humans results in different
'Land uses,' which are determined by both human activities and the physical characteristics of the
land.
The utilization of land is impacted by human needs and environmental factors. In countries
like India, rapid population growth and the emphasis on extensive resource exploitation can lead
to significant land degradation, adversely affecting the region's land cover.
Therefore, human intervention has significantly influenced land use patterns over many
centuries, evolving its structure over time and space. In the present era, these changes have
accelerated due to factors such as agriculture and urbanization. Information regarding land use and
cover is essential for various planning and management tasks related to the Earth's surface,
providing crucial environmental data for scientific, resource management, policy purposes, and
diverse human activities.
Accurate understanding of land use and cover is imperative for the development planning
of any area. Consequently, a wide range of professionals, including earth system scientists, land
and water managers, and urban planners, are interested in obtaining data on land use and cover
changes, conversion trends, and other related patterns. The spatial dimensions of land use and
cover support policymakers and scientists in making well-informed decisions, as alterations in
these patterns indicate shifts in economic and social conditions. Monitoring such changes with the
help of Advanced technologies like Remote Sensing and Geographic Information Systems is
crucial for coordinated efforts across different administrative levels. Advanced technologies like
Remote Sensing and Geographic Information Systems
9
Changes in vegetation cover refer to variations in the distribution, composition, and overall
structure of plant communities across different temporal and spatial scales. These changes can
occur natural.
Gender and Mental Health - Counselling and Family Therapy Applications and In...PsychoTech Services
A proprietary approach developed by bringing together the best of learning theories from Psychology, design principles from the world of visualization, and pedagogical methods from over a decade of training experience, that enables you to: Learn better, faster!
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) CurriculumMJDuyan
(𝐓𝐋𝐄 𝟏𝟎𝟎) (𝐋𝐞𝐬𝐬𝐨𝐧 𝟏)-𝐏𝐫𝐞𝐥𝐢𝐦𝐬
𝐃𝐢𝐬𝐜𝐮𝐬𝐬 𝐭𝐡𝐞 𝐄𝐏𝐏 𝐂𝐮𝐫𝐫𝐢𝐜𝐮𝐥𝐮𝐦 𝐢𝐧 𝐭𝐡𝐞 𝐏𝐡𝐢𝐥𝐢𝐩𝐩𝐢𝐧𝐞𝐬:
- Understand the goals and objectives of the Edukasyong Pantahanan at Pangkabuhayan (EPP) curriculum, recognizing its importance in fostering practical life skills and values among students. Students will also be able to identify the key components and subjects covered, such as agriculture, home economics, industrial arts, and information and communication technology.
𝐄𝐱𝐩𝐥𝐚𝐢𝐧 𝐭𝐡𝐞 𝐍𝐚𝐭𝐮𝐫𝐞 𝐚𝐧𝐝 𝐒𝐜𝐨𝐩𝐞 𝐨𝐟 𝐚𝐧 𝐄𝐧𝐭𝐫𝐞𝐩𝐫𝐞𝐧𝐞𝐮𝐫:
-Define entrepreneurship, distinguishing it from general business activities by emphasizing its focus on innovation, risk-taking, and value creation. Students will describe the characteristics and traits of successful entrepreneurs, including their roles and responsibilities, and discuss the broader economic and social impacts of entrepreneurial activities on both local and global scales.
Traditional Musical Instruments of Arunachal Pradesh and Uttar Pradesh - RAYH...
Evaluating Extension Programe Outcomes
1. EVALUATING EXTENSION
PROGRAM OUTCOMES
Agricultural Extension Service
Institute of Agriculture
University of Tennessee
Prepared by:
Richard L. Poling
Associate Professor
Agricultural and Extension Education
3. EVALUATING EXTENSION PROGRAM OUTCOMES
by
Richard L. Poling
Associate Professor, Agricultural and Extension Education
University of Tennessee Agricultural Extension Service
In determining the effect of Extension educational programs, the objectives of the program
are usually the guides from which potential program outcomes are determined. However, many
outcomes of Extension programs are serendipitous in nature. We don't always plan on all the
outcomes that actually do occur. Keeping that in mind, the program objectives are still the best
places to start in developing a program evaluation plan.
The best time to begin developing the evaluation plan is when the program planning
process itself begins. In each step of the program planning process, decisions are made that will
affect how the program evaluation will be developed. The answers to the questions - What will
the program subject matter include? Who will be the recipients of the program? What are the
expected outcomes of the program? and What methodologies will be used in the delivery of the
program? - all contribute to the and implementation of the program evaluation. Well-written
program objectives address design most of these questions and become the cornerstones of the
evaluation.
An easy way to approach developing an evaluation plan is to remember to do the
following:
Ask the RIGHT PEOPLE
for the RIGHT INFORMATION
in the RIGHT WAY.
This means that, to evaluate a program, one must first identify the right sources of information
that will provide information to determine the outcomes of a program. Once the sources have
been identified, the information needed from those sources that address the expected program
outcomes must be determined. Then, that information must be collected using data collection
techniques that are appropriate for the sources of information and the environment in which the
program is being conducted.
A more structured outline of items that need to be addressed when planning a program
evaluation is shown in Figure 1. As each item is addressed using this form, more information is
provided as to how the evaluation will be conducted, including: what are the expected outcomes
of the program (objectives), what questions need to be addressed, what sources of information
will be used, what methods of information collection will be used, and how will the results of the
evaluation be used.
__________________________
Revised 8-99
1
4. FIGURE 1. EXTENSION PROGRAM EVALUATION _________________________________________________________________
WORKSHEET
_________________________________________________________________
Use the following as guidelines in developing an evaluation plan for Extension programs.
_________________________________________________________________
1. Program, project, or activity to be evaluated: ___________________________
_________________________________________________________________
_________________________________________________________________
7. What information collection method(s) is/are appropriate?
_________________________________________________________________
_________________________________________________________________
2. Objective(s) of program [including level(s) of Bennett/Rockwell’s TOP Model
Hierarchy]: _________________________________________________________________
_________________________________________________________________ _________________________________________________________________
_________________________________________________________________ _________________________________________________________________
_________________________________________________________________ 8. How and to whom will evaluation results be reported?
_________________________________________________________________ _________________________________________________________________
3. What questions are you trying to answer with the evaluation? _________________________________________________________________
_________________________________________________________________ _________________________________________________________________
_________________________________________________________________ _________________________________________________________________
_________________________________________________________________ 9. What resources will be needed to conduct the evaluation? (Money, personnel,
equipment, etc.)
_________________________________________________________________
_________________________________________________________________
4. Who are the stakeholders for the program being evaluated?
_________________________________________________________________
_________________________________________________________________
_________________________________________________________________
_________________________________________________________________
_________________________________________________________________
_________________________________________________________________
5. What information is needed by stakeholders from the evaluation?
_________________________________________________________________
Prepared by Richard L. Poling, Evaluation Specialist, University of Tennessee Agricultural
_________________________________________________________________ Extension Service.
_________________________________________________________________
6. What/who are the information sources for the evaluation?
2
5. "ASKING THE RIGHT PEOPLE"
Asking the right people means identifying the best sources that can provide the
information needed to evaluate a program. Program objectives are critical tools in identifying
information sources. Objectives should identify program recipients, subject matter, and
outcomes. With this knowledge, the program evaluator can identify the most appropriate sources
of information. The following should also be taken into consideration when identifying the right
sources of information.
1. A Source - the unit from which information is collected.
An information source may be a person or persons or the evidence left by a person.
There are a variety of different sources that may be identified for a particular
program evaluation. The selection of sources needs to be based upon certain
criteria. How an information source is chosen should be based on the following:
a. The source should be able to provide information related to evaluation
needs.
b. The source should be available. (May not be accessible.)
c. Possibility of involvement. (May refuse to participate.)
d. Cost restrictions to getting information. (Information collection costs may
be very expensive.)
e. Time involved.
f. Resources needed.
g. Credibility of information received.
h. Usability of information received.
i. Evaluator's skills.
EXAMPLES OF INFORMATION SOURCES:
HUMAN SOURCES
Program participants Relatives/friends
Teachers/Supervisors Program providers/staff
Community leaders/officials Program administrators
"Experts" General public
Advisory committees Professional colleagues
Fund sources
SOCIAL INDICATORS
Studies Reports
Complaints Agency records
News articles/reports Public documents
3
6. PHYSICAL EVIDENCE
Observation of outcomes of:
- skill changes
- practice changes
- end results
In deciding on information sources, especially people, the individual receiving the program
will often be the source of information about program outcomes (Ex. knowledge or skill change
or practice adoption). There may be times when people other than the program participant would
be the appropriate source of information. For example, if an objective of a program was to have
young children adopt new behaviors, parents or teachers of the children might be good sources of
information as to whether or not those behaviors have been adopted.
4
7. "FOR THE RIGHT INFORMATION"
Clear, measurable program objectives are the best source about what information should
be collected in a program evaluation. Objectives should be written so that they identify what are
the expected outcomes of the program and at what level of the Bennett/Rockwell Targeting
Outcomes of Programs (TOP) Model Hierarchy are the outcomes. The TOP Hierarchy is a
model for program development, objective writing and evaluation widely used in Extension work.
The TOP Model consists of seven levels of expected inputs and outcomes that take place through
Extension programming efforts. The hierarchy and brief descriptions of program inputs and
outcomes at each level are shown in Figure 2.
Looking at the hierarchy, one can see that levels 1 (Resources) and 2 (Activities) describe
what Extension does to produce and conduct educational programs. Levels 3 (Participation)
through 7 (SEEC) are representative of outcomes that result from participation of clientele in
Extension educational programs. Levels 5 (KASA), 6 (Practices) and 7 (SEEC) are more often
seen as the real "impact" levels of Extension programming. In general, the following statements
are found to be true in relation to the levels of the Bennett/Rockwell TOP Model Hierarchy:
1. Evidence of program impact becomes stronger as the hierarchy is ascended.
2. The difficulty and cost of obtaining evidence on program accomplishments
increases as the hierarchy is ascended. (NOTE: Costs include time and personnel,
as well as dollars.)
3. Evaluations are strengthened by assessing Extension programs at several levels of
the hierarchy.
Figure 2.
Bennett/Rockwell TOP Model
(Targeting Outcomes of Programs)
Program Development Program Performance
SEEC SEEC
Practices Practices
KASA KASA
Reactions Reactions
Participation Participation
SEEC: Activities Activities KASA:
S = Social Resources Resources K = Knowledge
E = Economic A = Attitude
E = Environmental S = Skill
C = Conditions A = Aspiration
5
8. To determine the degree of attainment of program objectives, specific criteria are needed.
These criteria identify what measures or data will be collected to demonstrate that the objective
has been reached. These measures may vary in quality. This variation in data quality is often
referred to as "hard" versus "soft" data. "Hard" and "soft" data represent opposite ends of a
continuum, not a dichotomy.
The "hardness" of data is based upon the three qualities of validity, quantification, and
representativeness. Validity of data is the extent that they truly reflect the characteristics of
subjects or situations being studied. The dimension of quantification relates to the amount or
degree of differences that exist between data. Differences are usually represented through the
assignment of numerical values to the observations that can then be used to show how much the
differences are among subjects on the measures used in the evaluation. Representativeness is the
extent to which observations of subjects or situations being evaluated are applicable to a larger
population or situation. Representativeness can be enhanced by studying the entire populations or
a representative sample of the population.
The degree of "hardness" of data depends upon trade-offs between ideal data and the data
needed and resources available to collect data. "Hard" data are more expensive and difficult to
obtain and should only be collected when the benefits to decision-making from superior evidence
clearly outweigh the costs of obtaining such evidence. Stakeholders in the Extension program
should be involved in the determination of the "hardness" of data needed and what trade-offs will
be made to collect the type of data needed. Stakeholders include program planners, supervisors,
and program funders.
There are many situations where "soft" data on accomplishment of objectives are all that
can be obtained. Program participants are often unwilling or unable to be observed or to respond
to instruments which require detailed answers and/or extensive time to complete. A guide for
determining the "hardness" of measures used as evidence of achievement of objectives is to collect
evidence of a "hardness" that will meet the needs of stakeholders and the resources available to
collect the evidence. Table 1 shows examples of "hard" and "soft" data at each level of the TOP
Model Hierarchy.
What Questions to Ask:
At each level of the TOP Model Hierarchy, there are certain questions that need to be
answered in the evaluation process to determine if objectives have been achieved. The questions'
structures will depend on at what level of the hierarchy is the objective and , possibly, on whether
the data is to be "hard" or "soft." Below are examples of types of questions or items that will
collect data to address the evaluation questions at different hierarchy levels. The examples
presented are not the only ways to ask the questions.
6
9. Table 1. Examples of "hard" and "soft" evidence in the Bennett/Rockwell TOP Model
Hierarchy
EXAMPLES
LEVEL
"Hard" Evidence "Soft" Evidence
7. SEEC Trends in profit-loss Perceptions of changes in
Change statements, live birth weights quality of economy, health or
of babies, reduction of the environment.
pesticide residues in well
water sources.
6. Practices Direct observation of use or Self-reported use of
Change evidence of clientele use of recommended practices by
recommended practices. clientele.
5. KASA Change Changes in scores on Self-reported perceptions of
validated measures of change in participants'
knowledge, attitudes, skills knowledge, attitudes, skills,
and aspirations. Direct and aspirations.
observation of skills.
4. Reactions Direct observation or Recording the views of only
measurement of all or a those who volunteer
representative sample of reactions about the program
participants reactions during (non-representative sample).
and/or after a program.
3. Participation Use of sign in sheets, Casual observation of
recorded observation of attendance and leadership
individuals participating or given by participants.
holding leader positions.
2. Activities Pre-structured observation of Staff recall of how activities
activities and social processes were conducted and the
through participant extent to which they were
observation, use of video or completed.
audio tapes, etc.
1. Resources Documentation of staff time Staff's subjective reports
and resource allocations regarding time allocation.
through a formal process.
7
10. RESOURCES LEVEL
What were the total number of staff days expended in the planning and conducting of this
program?
How many dollars were expended in the planning and delivery of the program?
ACTIVITIES LEVEL
How many educational activities and programs were conducted in ______________?
How many news articles were published related to the ________________ program?
PARTICIPATION
How many individuals participated in educational programs on ________________ as
indicated on sign-in sheets?
How many people served as members of the program committee for the __________
program?
REACTIONS
Reactions are the responses of clientele as to the value or quality of programs, teachers, teaching
methods used, materials, facilities and other factors involved in the program. Reactions should
not be confused with KASA changes. A person indicating that the program was well presented
and met their needs is not documentation for knowledge or skill change.
"Hard" Data
Observation of reactions of program participants during the program presentation.
Experimental designs can be used to provide "hard" data of the value of programs to
participants (e.g. providing a "distraction" to participants that might lure them away from
participation if they are not really interested in the program).
"Soft" Data
Asked of participants using either a check list (Check All That Apply), a dichotomous
scale (ex. YES/NO) or a Likert-type scale of three or more levels (ex. STRONGLY
AGREE to STRONGLY DISAGREE):
(NOTE: Blanks in items are for the subject matter or topic that was taught.)
This workshop helped provide a good background on ________________________?
8
11. REACTIONS (Cont.)
The program provided little useful information about _________________________.
The presenter appeared to be knowledgeable about __________________________.
The written materials used in this program were appropriate.
This was one of the best programs on ___________________ that I have attended.
Open-ended reaction questions can also be asked, but remember that you will probably not
get as many responses to open-ended questions and open-ended data will be more difficult
to summarize and to analyze the results.
What were the three things that you liked the most about the program?
How could the program have been improved?
KASA CHANGE
KASA changes are measured in several ways depending on whether "hard" or "soft" data are
desired. "Hard" measures of knowledge, attitude (opinion) and skills changes are obtained either
through validated measurement instruments or observations and pre-test, posttest measurements
"Soft" measures of knowledge change are self-reported perceptions of participants as to how they
feel their knowledge has changed. "Soft" measures could also use pre-test, posttest
measurements to provide slightly "harder" data.
Knowledge:
"Hard" Data
Pre- and post-program scores on a knowledge achievement test are compared to
determine knowledge change. The test must be validated to ensure that it is actually
measuring the knowledge you want. Responses to test items can be True/False, multiple
choice, or fill in the blank. Open-ended essay questions can be used, but validation,
analysis, and summary of such questions will be difficult.
"Soft" Data
Items for responses from participants. Responses may be similar to those described for
reaction level items: True/False, Yes/No, Strongly Agree to Strongly Disagree, Check All
That Apply.
As a result of my participation in this program, my knowledge of
______________ has increased.
9
12. Knowledge (Cont.):
The information provided by the agent has increased my knowledge about
__________________.
As a result of my participation in this program, my knowledge of the following
topics has increased:
(LIST TOPICS COVERED AND HAVE PARTICIPANT RESPOND TO
EACH TOPIC)
Attitude (Opinion):
"Hard" Data
Pre- and post-test scores on a validated instrument that measures the attitudinal construct
being addressed by the program. A number of such instruments have been developed and
are available for use (often at a cost) when appropriate for the program. NOTE: Attitude
change is often difficult to achieve through short-term programs. Objectives that state a
change of attitude as an outcome with minimal contact with participants are very difficult
to achieve and should be given much thought before being adopted.
"Soft" Data
Items for responses from participants. Responses may be similar to those described for
reaction level items: Yes/No, Strongly Agree to Strongly Disagree, Check All That Apply.
I feel more positive about my abilities to succeed in school as a result of this
program.
I believe more in the importance of collaboration in achieving group goals than I
did before participating in this program.
Skills:
Skills can be measured the same way as knowledge, by perceptions or by actual testing of skills.
If you are teaching skills that can be performed, why not have participants perform the skills for
you at the end of the program?
"Hard" Data
Observation of participants demonstrating learned skills serves as evidence of skill
development. A checklist of skills demonstrated is used for documentation. Pre-program
skill levels should also be demonstrated, if possible, to document change.
10
13. Skills (Cont.):
"Soft" Data
Items for responses from participants. Responses may be similar to those described for
reaction level items: Yes/No, Strongly Agree to Strongly Disagree, Check All That Apply.
As a result of my participation in this program, my ability to _____________
______________ has increased.
I can ______________ better than I could before participating in this class.
Aspirations:
"Hard" measures of aspiration are difficult to imagine. Aspirations are really self-reported
perceptions ("soft" data) of participants as to the likelihood that they will do something or change
the way they do something as a result of participating in the program. NOTE: Aspirations are not
the same as Practice Change. Aspirations are indications that participants intend to use or adopt
what was learned, not that they have already used it.
Items for responses from participants. Responses may be similar to those described for
reaction level items: Yes/No, Strongly Agree to Strongly Disagree, Check All That Apply.
As a result of participating in this program, what practices or behaviors do you
plan to adopt, or utilize more often? (Practices/Behaviors)
.
I plan to adopt, or utilize more often, the following practices that I learned in this
program:
(LIST PRACTICES/BEHAVIORS INCLUDED IN PROGRAM)
PRACTICES (CHANGE):
Practice change is a measure of changes in or adoption of behaviors or practices by participants.
Measures can be actual observed behavior/practice change or self-reported perceptions of
change/adoption.
"Hard" Data
Observed adoption of new practices, techniques, or behaviors that were learned through
participation in the program. Practice adoption can be documented on a checklist by the
observer. Secondary evidence of adopted practices/behaviors can also be observed.
11
14. PRACTICES (CHANGE): (Cont.)
"Soft" Data
Items for responses from participants. Responses may be similar to those described for
reaction level items: Yes/No, Check All That Apply.
As a result of participating in the ____________ program, I am now using the
following practices:
(LIST PRACTICES PRESENTED IN PROGRAM)
Based on what I learned in the EFNEP program, I now prepare more nutritious
meals for my family.
SOCIAL, ECONOMIC, AND ENVIRONMENTAL CONDITIONS (SEEC)
SEEC changes are things that happen to clientele and/or communities as a result of knowledge
and practice/behavior changes of program participants. SEEC changes are sometimes hard to
document. But, in some cases, they might be fairly easy to document, especially when
quantitative data has already been collected as a part of the system being measured (ex. farm
records, demographic statistics). Sometimes, linking SEEC changes to Extension programs
appears to be difficult. However, by demonstrating efforts and results at other levels of the
hierarchy, a better case can be made that Extension programs have been a factor in the SEEC
change achieved.
"Hard" Data
"Hard" measures of end results would include documented effects of changes program
participants have made. Examples would include: increased profits for business/farm
operations, documented reduction in specific health problems in communities where
programs have been implemented, reduction in environmental problems in areas where
program participants have adopted new practices.
"Soft" Data
Perceptions (not supported by quantifiable data) of participants, community members or
officials as to changes that have occurred as a result of programs. Items for responses
from participants. Responses may be similar to those described for reaction level items:
Yes/No, Strongly Agree to Strongly Disagree, Check All That Apply.
The economy of the community has improved as a result of Extension community
development programming.
Extension water quality programs have resulted in fewer contaminated wells in
the county.
12
15. SOCIAL, ECONOMIC AND ENVIRONMENTAL CONDITIONS (SEEC): (Cont.)
The highways and roads are a lot cleaner as a result of the Keep America
Beautiful program in _____________ County.
No matter what questions you determine need to be answered at what level of the
hierarchy, it is extremely important that you ask only for the information that is necessary to
the evaluation and that you ask for the information in the simplest fashion possible!
13
16. "THE RIGHT WAY"
When the right information sources have been identified and the right information to be
asked has been determined, the next step is to make sure that we ask for the information in the
right way. Data collection is as much an art as it is a science. What data collection methods to
use and how to apply them in particular situations is a multi-layered set of decisions that the
evaluator must make for each program being evaluated.
There are several considerations that have to be addressed in order to select the most
appropriate data collection methods. These include:
The Kinds and Amount of Data That are to be Collected
- Do they imply specific methods or instruments?
ex. Actual knowledge change implies use of an achievement test.
- Do they imply a particular evaluation design? (comparison groups, multiple measurements,
random assignment or random sampling of participants)
ex. If you are interested in evaluating the performance of participants versus non-
participants, you would collect data from both groups.
- Are they "hard" or "soft" data?
ex. "Hard" measures of Practice Change require direct observation, "soft" Practice Change
measures may be self-reported by participants using a survey instrument.
The Needs of Evaluation Users/Stakeholders
- What do they expect? Noted evaluation expert, Michael Patton says, "It is critical that
intended users participate in the making of measurement and methods decisions so that
they understand the strengths and weaknesses of the data -- so they believe in the data."
(p.224, Utilization-Focused Evaluation, 1986)
ex. Supervisors who participate in the development of program evaluation plans will
accept the evaluation measures that result from that plan.
- What will they accept?
ex. Quantitative results or Qualitative results, "hard" or "soft" data, sample of participants
or all participants.
14
17. Information Sources
- Are there any special attributes of the information source(s) that would indicate that
certain methods would be more appropriate than others. Such attributes could include:
Size of the Population or Sample - A larger population or sample size could result in
the use of methods that result in less direct contact
with subjects due to costs of collecting larger
amounts of data. (Ex. A mail survey instead of face-
to-face interviews.)
Location or Dispersion of
Subjects (Near or Far Away,
Clustered or Widely-Dispersed) - Subjects located near to the evaluator or located in
close vicinity to each other can be contacted using
face-to-face or telephone interview methodology
easier and at less cost than if they were at a distance
or scattered over a wide area, in which case mail
surveying might be the cost-effective method.
Participants meeting as a group for a program offer
the easiest access for the evaluator through the use
of a group administered survey or interview.
Age (Very Young or Very Old) - Very young children may not be able to read a mail
survey, so interviews may be a better choice.
Responses such as Strongly Agree or Strongly
Disagree may not have much meaning to children, so
"smiley" faces may be used to represent responses of
children. Parents or teachers may be good sources
of information about knowledge or behavior changes
in children.
Older people may have problems with sight or
hearing. Surveys may have to be produced in large
print. Interviewers may have to speak louder or
plan on additional time in which to complete the
interview. Older people may be more suspicious of
strangers trying to collect information about them.
More time and effort may be needed to explain the
purpose of the evaluation and provide adequate
identification.
15
18. Ability (Mental, literacy,
physical, language) - How do you measure individuals with widely differing
mental abilities (both high and low)? May have to develop
instruments and collection methods differently for each
group.
Adjustments in instrumentation and collection
methodology may have to be made for populations
with low reading/writing abilities. Somewhat similar
to young children, but you must be careful not to
treat adults like children.
Adjustments in data collection may be necessary to
insure that physically disabled individuals have the
same opportunities to participate as information
sources as those who are not disabled. Orally
administered surveys for blind participants, visually
administered or signed interviews for deaf
participants, or access to facilities for focus group
interviews for a person in a wheelchair.
When collecting data from populations who do not
speak English, instruments and interview schedules
will need to be translated carefully into the subjects'
native languages. Those administering the
instruments will also have to speak and understand
the language. Translations into other languages
need to be done with caution as certain phrases have
different meanings in other languages.
Cultural Differences - Concepts and terms used in survey instruments or
interviews may not be easily interpretable across cultures.
Testing of instruments and evaluation questions with
individuals from the culture is a good idea.
A common cultural stigma is a reluctance to divulge
information to those outside of the culture. Subjects
may refuse to participate or may provide invalid
responses. The use of trained individuals from
within a culture to collect evaluation data may be
necessary. Additional time and effort may be needed
to develop trust with participants.
16
19. Socio-Economic Status - Accessibility may be a problem. Lack of telephone
or frequent moving of subjects may make it difficult
to contact individuals through mail surveys or phone
interviews. Interviewers may be reluctant to go to
subjects' location for face-to-face interview due to
fear of possible harm, either real or perceived.
Again, the use of trained individuals from the socio-
economic background of the subjects may help to
make the necessary contacts.
Socio-economic status (SES) is very similar in
nature to a cultural difference. Participants from
one socio-economic level may be suspicious of those
outside of their SES. They may refuse to participate
as an information source or give socially acceptable
or invalid responses. Similar to cultural differences,
the use of individuals for data collection from similar
SES backgrounds as the participants may be
appropriate. Otherwise, additional time and effort
will be needed to develop trust between the
participants and the evaluator.
The adjustments in data collection methods, use of additional individuals as data collectors
and the development of instrumentation that fits the special needs of the information sources will
result in the collection of more valid and complete data. However, it must also be kept in mind
that these adjustments will result in higher costs in conducting the evaluation in terms of both
dollars and time. The trade-off of more complete and valid data versus costs is a major decision
to be made by the evaluator.
Limitations
The following are limitations that may or may not hamper an effective program evaluation.
Each limitation or a combination of limitations will result in decisions about what evaluation
methods will be most appropriate for a given situation. Understanding these limitations during the
evaluation planning stage will help to avoid an evaluation beyond the means available to conduct
it.
- Money (includes costs of hiring additional personnel, travel, telephone, printing
instruments, mailing surveys, etc.)
- Time (time involved in developing and testing instruments, training personnel, collecting
data, entering results, analyzing data, and preparing reports)
- Resources (in addition to money and time, facilities and equipment use are resources)
17
20. - Skills/Abilities of the Evaluator (certain methods of data collection require certain skills
and abilities that the program evaluator may not possess or have the ability to acquire)
The key to selecting appropriate data collection methods is to identify a method or
methods that best addresses the above considerations. A combination of methods could end
up being the most appropriate choice.
18
21. DATA COLLECTION METHODS
Data collection methods can be categorized as quantitative or qualitative. However, these
classifications are made on the basis of the type of data collected rather than on the method itself.
A particular method can be used to collect either quantitative data, qualitative data or both.
There are situations where one method is more appropriate for collecting a certain types of data.
The following information will identify some of those situations.
SURVEYS
Surveys can be used to collect information on attitudes, beliefs, behaviors, reactions, and
attributes of respondents. They can be relatively inexpensive ways to collect information from a
large number of people. Surveying a sample of a population can provide information about that
population. However, samples must be carefully selected to avoid misinterpretation of results.
Surveys can also be used to collect data from an entire population and give many persons in that
population a feeling of being involved in the process.
Results from surveys may also be misinterpreted depending on how questions and
response categories are designed. There is also a tendency for survey data (especially quantitative
data) to be limited in nature, often reporting what "is" without addressing the underlying reasons
"why" or actual behavior patterns.
Survey questions can range from structured close-ended responses (yes-no, true-false,
agree-disagree, demographics) that provide quantitative information to unstructured open-ended
responses that provide qualitative data.
The most commonly used survey methods are: mail surveys, group administered surveys
(after meeting survey), telephone surveys, and face-to-face interviews.
Mail Surveys
The mail survey is a cost-efficient method for the volume of data collected. However, the
costs are increasing. People are likely to provide responses to a well-designed and conducted
mail survey. Even though low response rates can be a problem (especially with specialized
groups), good management of the mail survey process, including follow-up of non-respondents,
can result in response rates of 70% and higher. Use of the mail survey technique by private
organizations and businesses to solicit money and sell products has made some people reluctant to
respond to mail surveys. The intent and importance of the survey must be clearly outlined to
these individuals to assure them that the surveyor is not "selling" something. Assurances of
confidentiality or anonymity are very important, especially when the information collected in the
survey is sensitive or controversial.
The survey instrument used in a mail survey must be developed with care. The respondent
will have no one to clarify information for them as they fill out a mail survey, so the instrument
19
22. must be simple and easy to understand. This means that a lot of work must be done in the
development of the survey instrument to guarantee its validity, reliability, and clarity. Pre-testing
of the instrument is a must.
Mail surveys are not very effective in the collection of qualitative data. Open-ended
questions can result in responses that often depart from the intent of the question due to
misinterpretation by respondents. In these cases, it is very difficult to summarize responses to
open-ended questions.
Group Administered Surveys
(Post-Program Surveys)
Group administered surveys are similar to mail surveys except they are administered
directly to individuals who are participating in a group activity. Everyone attending a meeting,
etc. completes a survey form. This method allows for the administration of pre- and posttests to
identify changes, as well as the traditional post-meeting survey. This method is an inexpensive
way to collect data from individuals. A high response rate is usually possible with this method,
especially if the participants are made aware of the importance of the survey and how it will be
used to improve programs and provide accountability for the program. Because the surveyor is
present, it is much easier to clarify items and respond to questions from individuals, which can
allow for the inclusion of more open-ended items. It is also easier to guarantee anonymity for
respondents due to the lack of a need for identity of respondents on the survey.
This method does allow for possible influence of the surveyor on results and the mood of
the meeting may influence individual responses, either positively or negatively. Group
administered surveys allow only for the collection of data from those present at that activity.
Telephone Surveys
Conducting a survey by telephone is competitive in cost per response with mail surveys.
Generally, response rates are high. Once people answer the telephone, they are likely to agree to
respond to a well-designed telephone survey process. Telephone surveys usually do not allow for
the collection of data from as many individuals as do mail surveys, depending on the amount of
resources available and the size of the population being surveyed. The actual time to collect data
is much shorter for telephone surveys than for other methods, but as much or more time is needed
to develop a telephone survey instrument and train additional interviewers, if used, then is needed
for mail surveys.
Telephone numbers used in telephone surveys can be obtained from several sources.
Phone numbers of program participants can be obtained from sign-in sheets from the program or
activity. Telephone directories are a good source of numbers for the general public, but
unpublished numbers can prevent certain individuals from being included. Random digit dialing
(RDD) can help by accessing all working numbers in the area of the survey. RDD can result in
contacts with non-usable numbers (businesses, public and private agencies, etc.). If a specific
20
23. subgroup is of a population is being surveyed, it would be necessary to have phone numbers for
those individuals.
The presence of an individual asking questions over the phone can provide clarification for
respondents. Telephone interviewers must be careful, however, that their voice inflections or
statements don't bias responses. Training of interviewers is a necessity to avoid this from
happening.
Telephone interviewing forms can be more complex than a mail survey instrument. More
complex skip patterns can be included in a telephone interview form that can simplify the
elimination of non-applicable questions for respondents. There are limitations to the lengths of
questions and number of response categories per question on a telephone survey form because the
respondent isn't able to visualize the survey form. Telephone interviewing is a good technique to
use in the collection of qualitative data through open-ended questions, especially if the interview
is tape recorded for accuracy of responses. In this sense, a telephone survey is similar to a face-
to-face interview. Computer assisted telephone interviewing (CATI) is also making the use of
telephone surveys much easier.
Face-to-Face Interviews
Face-to-face interviewing as a survey method is the most expensive method when
compared to mail and telephone surveys. It is also the slowest method in terms of actual data
collection. Face-to-face interviewing is not very appropriate for collecting data from a large
number of individuals in a population due to the high cost of resources (interviewing personnel,
travel, data management and analysis) and time involved. It is, however, a good way to collect in-
depth qualitative data from individuals. For specific audiences (the poor, the mobile, high status
individuals, etc.), face-to-face interviewing may be the only way to collect data. When special
segments or individuals of a population have been identified as information sources, it may be
easier to interview these individuals face-to-face. Response rates for this method of data
collection are likely to be high as individuals are more reluctant to refuse to talk to someone face-
to-face.
For collecting in-depth qualitative data from individuals, a face-to-face interview is
preferable to other methods. Quantitative data from close-ended questions can also be collected
using face-to-face interviews, but this same information can often be collected quicker and at a
lower cost by either mail survey or telephone survey.
The presence of the interviewer in face-to-face interviews can both help and hinder the
data collection. The interviewer can use probes to gather more in-depth information and pick up
on non-verbal cues from the respondent. Some people prefer the personalized touch of having a
"real person" to respond to. However, the interviewers presence and personal characteristics may
be a biasing factor for how some people respond to questions. Individuals may be less frank or
thoughtful about responses than they might if they were filling out a mail survey or responding to
an unseen individual in a telephone survey. The lack of anonymity may bother some respondents.
21
24. If individuals other than the program evaluator are conducting the face-to-face interviews,
they must be trained in how to avoid biasing responses by their actions or questioning. If
possible, face-to-face interviews can be tape recorded to insure accuracy of responses, as well as
to include some idea of the intensity and personality in responses.
OTHER METHODS
In addition to surveys, there are other methods for collecting data, both quantitative and
qualitative. These methods can be used by themselves or, more likely, in conjunction with one of
the survey methods to collect data accurately representing people's attitudes, beliefs, behaviors,
reactions and attributes.
Group Interviews
(Focus Group Interviews)
Group interviews, sometimes called focus group interviews (FGI) if "focused" on a
particular topic, provide in-depth qualitative data similar to that of face-to-face interviewing.
Because more individuals are involved in each interview, group interviews are usually less
expensive and collect data faster than the face-to-face process. Group interviews are usually not
used for the collection of quantitative data.
In addition to getting responses from individuals to questions, group interviews also
provide an atmosphere where responses from individuals stimulate additional thoughts by others
in the group. This synergy usually results in gaining information beyond what even the
interviewer expected. In fact, group interviews can be very challenging to the interviewer in
terms of keeping the discussion and responses on track with the topic at hand without stifling the
enthusiasm of group members to respond to the questions and each other.
In a group interview situation, more outgoing or aggressive individuals can dominate the
responses and intimidate less dominant members of the group. The interviewer must control this
situation and insure that all group members have the opportunity to present their own viewpoints.
The skills of the group interviewer is very influential in how accurate the results of a group
interview will be.
Several authors have developed procedures for conducting focus group interviews that
address solutions to the potential problems that may bias interview results.
Observation
Observation is the systematic gathering of behavioral actions and reactions through the use
of specific instruments or professional impressions. Information can be collected in a number of
ways: by watching, listening, and documenting what is seen and heard; by asking questions; by
sharing activities and noting comments, behaviors, and reactions; or a combination of these. It is
important, however, that the observation and documentation be carried out in a
22
25. systematic manner so that the information obtained is as free as possible of bias and is relevant to
the focus of the study.
Observation of individuals can be done by the evaluator or others trained to systematically
observe and record information. If more than one observer is used, inconsistencies between
observers will bias results. Training of observers is very important. The observers may make
their identities known to the subjects or may keep their identities a secret. They may choose to
participate in the activity being observed or may observe passively. If individual(s) are aware that
they are being observed, they may behave differently than normal, but the principles of right of
privacy and informed consent may require that they be made aware. The observer can also lose
objectivity as a result of actually being involved in the activity.
Observation is useful for studying small units such as a class or committee, but is not
realistic for studying large groups. Observations may not be valid for the entire population. If
generalization of results to the population is desired, a plan needs to be developed to insure that
those observed are representative of the population. Results of observation can be combined with
other techniques to add to the quality of data collected.
Case Studies
A case study is a method to provide in-depth information about a single program or
situation. A variety of other data collection methods, such as surveys, interviews and existing
documents, are used to capture the total picture of the program. The case study technique often
finds significant information about program processes or impacts that may not have been
anticipated. This method is generally utilized with a small number of individuals or groups.
Case studies involve extensive amounts of data collection and can be very time consuming.
Specific techniques for data collection will be tailored for the individual case. The results of a
case study can be very subjective, requiring judgements by those using results. Results of a case
study are best used as background information and as a guide for further study or action.
Analysis of Existing Information
Before any new data are collected, a thorough check should be made of what information
is already available through existing sources. Although extensive data on the program or
individuals included in your study may not exist, there may be background information or
particular variables available that could save time and costs in your data collection process.
Existing information will usually support information collected through other methods.
Sources of existing data are reports, historical accounts, summaries of previous surveys or
reviews, meeting minutes, budgets and staff records. These sources may include information that
has been collected specifically for the purpose of documenting programs or has been collected for
other purposes but serves as a measure of the program being studied or information that is
23
26. part of the administrative database of the organization being studied. Access to some of these
sources may be limited due to privacy concerns if it relates to information about individuals.
Data from existing records, if available, is low cost and can be accessed on a continuing
basis. The user may have to spend time selecting and sorting the data. Problems sometimes exist
with incomplete data or estimated data as opposed to actual accounts. Data from these sources
have a tendency to be descriptive rather than looking at relationships.
DOCUMENTATION
One of the most important aspects of the program evaluation process is documentation of
evaluation efforts. Documentation of what took place in the program evaluation serves as
evidence of accountability to those who are interested in how the results were established.
Documentation can also be used to describe the evaluation process to those who might disagree
with the results or doubt the validity of the evaluation.
Documentation is a matter of having a record of the evaluation process from its
development in the program planning process to its conclusion with the analysis of the data
collected. Items that need to be a part of the documentation are:
- the program objectives, documents indicating the input and activities levels of the
program (agendas, written materials used in the program
- notices used to announce the program, etc.)
- instruments used to collect evaluation data, and
- summaries of evaluation results.
Some of this information may already be collected through other existing data collection
procedures (civil rights documentation, MIS, program planning documents).
SOURCES
Bennett, C. F. (1976). Analyzing impacts of Extension programs (ESC-575). Washington,
DC: Extension Service, USDA.
Bennett, C. F., & Rockwell, K. (1996, draft). Targeting outcomes of programs (TOP): an
integrated approach to planning and evaluation. Washington, DC: CSREES, USDA.
Dillman, D. A. (1978). Mail and telephone surveys: the total design method. New York:
John Wiley & Sons.
24
27. Patton, M. Q. (1986). Utilization-focused evaluation. Beverly Hills, CA: Sage.
Warner, P. D., & Maurer, R. C. (1984). Methods of program evaluation.
Lexington, KY: University of Kentucky.
25