Education

AGED 6223

PLANNING AND EVALUATION
OF EDUCATIONAL PROGRAMS IN AGRICULTURE

Education Program Evaluation
Leopold Center- Competitive Grants Program

Information for FY 1999 Competitive Grant Applicants

What is education program evaluation? Steele* suggests that:

Program evaluation is the process of judging the worth or value of a program. This judgement is formed by comparing evidence of what the program is with criteria of what the program should be.

*Steele, Sara, "Program Evaluation - a Broader Definition, "Journal of Extension, Summer 1970, p.8.

Criteria are the standards against which something may be judged. These may be accomplishments, aspirations, knowledge or skill levels, or behaviors. Evidence is the data one collects to document how well the criteria have been met.

All project proposals with educational objectives must include an evaluation plan. The evaluation plan needs to be realistic and directly relate to the project's objectives. Unrealistic objectives may make evaluation of the program difficult, if not impossible.

Not all educational programs can be designed and implemented to change behavior. Some programs may be designed to change knowledge or skill level, aspirations, or awareness. Others may emphasize materials development and testing. Evaluations should be flexible enough that additional benefits not part of the original plan can be realized and documented.

The educational program should drive the evaluation, not vice versa. Evaluation should not be so obtrusive that it significantly detracts from effective implementation of the educational program.

Keep your evaluation plan concise so it is no more than two pages in length. List evaluation costs (survey mailings, etc.) as a separate item in your proposal budget.

Educational programs cannot all be evaluated in the same manner. Each is unique, and consequently, each evaluation plan is unique. For example. an educational workshop will not follow the same evaluation plan as a field demonstration or a curriculum development project. The following Program Evaluation Planning guide and Example Project Objectives and Evaluation Plan are included to help you develop your evaluation plan. Use the same headings found in the Evaluation Planning guide when developing your evaluation plan.

Note: some educational programs or events may not lend themselves to the guidelines we have developed. Contact the Center before you finalize your proposal if you feel your project requires a different evaluation model (leocenter@iastate.edu or call 515-294-3711 and ask for Rich Pirog).

Education Program Evaluation Planning guide

Follow this guide when developing the evaluation plan for your proposal:

Education program to be evaluated (title and brief description)

Educational objectives (one or more)

State all the educational or demonstration objectives of your project in measurable, behavioral terms.

Criteria (predefining what is "success" for your project)

Describe an Acceptable level of accomplishment of reach educational objective.

Data collection (evaluation design and methods)

What data do you need to estimate the level of accomplishment for each objective?

Time frame and persons responsible

What is the timetable and who will be responsible for evaluation tasks?

Using your evaluation results.

	With whom and how will project investigators share evaluation information?
	What additional uses or applications can be made with the evaluation findings?

Example project Objectives and Evaluation Plan

Improvement in manure management have been identified as an important goal by farmers, community leaders, and educators in fictitious Pleasant County. An initial survey of livestock producers in the county indicates that only 15 percent are currently using university and agribusiness association recommended manure management practices.

A coalition of farmers and educators have developed a proposal with the following objective and evaluation plan:

Project Objectives(s)

The proposed two-year project has the following objective:

To achieve a 25 percent increase in the proportion of Pleasant County livestock producers analyzing manure for nutrient content, calibrating their manure spreaders, and taking nutrient credits for their manure.

Example Evaluation Plan

A. Education program to be evaluated:

Pleasant County manure management demonstration and information program - 1998-99.

B. Educational Objectives
#1

Livestock producers will attend two field days and intensive manure management workshops (total of four events).

#2

Participants will increase their knowledge of the value of manure as a resource and of testing soil and manure.

#3

Producers will adopt practices for analyzing manure content, calibrating manure spreaders, and taking nutrient credits.

C. Criteria 70% of Pleasant county livestock producers will attend at least 3 of 4 events.

50% of participants will increase their knowledge in areas noted in objective 2

25% more Pleasant County livestock producers will adopt practices in objective 3

D. Data Collection Field day and workshop rosters Field day and workshop evaluations Post-program survey responses

E. Time Frame and Persons Responsible Extension and Soil & Water Conservation District (SWCD) personnel within two weeks of each event.

Extension and SWCD personnel at the end of each event

Extension and SWCD personnel will arrange telephone or personal interviews within four months after second workshop

F. Using your Evaluation Results* Did those who attended both workshops learn more than those who attended only one.

Was there a relationship between increase in knowledge and level of adoption?

Did those producers who adopted all practices realize a greater savings by reducing fertilizer costs.

* Collaborators in this project, including participating producers and educators will share results form this project at field days and workshops in Pleasant county, at regional manure management programs, and in articles and interviews for local and regional newspapers and newsletters.