There are many types of evaluation. For example, some evaluations measure satisfaction, others measure program day-to-day operations, and others measure cost-benefit ratios.
However, RMYF funds a very specific type of evaluation that meets the following criteria:
- Outcome-based - We help programs measure the degree to which their services effect meaningful changes in the youth they serve.
- Logic-model-based - The logic model is a way to approach evaluation where that which is measured (in this case, outcomes) is the logical extension of the program's overall strategy. For example, in a logic model, the outcomes are a direct extension of the mission and are achieved through the programs activities. For more on the logic model, see the University of Wisconsin - Extension Web site or download the free W.K. Kellogg Logic Model Development Guide from the Kellogg Foundation web site.
- Quantifiable- We request that the evaluation collect data that can be expressed in numbers - for example, data that are absolute numbers, scales, or categories.
- Valid - We request that the evaluation meet minimum standards of validity. E.g., that it measure what it purports to measure.
- Utilization-focused - While research is very valuable, RMYF does not fund general research. Instead, it funds evaluation that is designed to generate findings that are usable by real people in the real world to help underprivileged youth reach their full potential.
- Professional - Although we hope that programs are closely involved in their evaluation, we require that the evaluations we fund be conducted or overseen by a professional evaluator or someone with equivalent credentials, experience and expertise. For suggestions on identifying an evaluator, see below.
- Abiding by experimental design (if possible) - Although we don't require evaluations to follow the experimental design (e.g., have a comparison group to test causality), we favor those that do.
Online Survey Tools
These resources might be helpful in crafting and conducting your program evaluation.
Patton, Michael Quinn. Utilization-Focused Evaluation. (Thousand Oaks, California: Sage, 1997). This text covers how to conduct program evaluations and why to conduct them in the manner prescribed. Each chapter contains a review of the relevant literature and actual case examples to illustrate major points. Finally, the book offers a definite point of view developed from observing much of what has passed for program evaluation that has not been very useful: Program evaluation ought to be useful and something different must be done if evaluation is to be useful.
United Way of America. Measuring Program Outcomes: A Practical Approach. (Alexandria, Virginia: United Way of America, 1996) This is an easy-to-follow step-by-step manual that uses the logic model, cites experiences of many types of agencies, includes worksheets, examples, and a bibliography on measurement issues and performance indicators. For more information on this publication, go to http://national.unitedway.org/outcomes/index.html.
The Urban Institute. Key Steps in Outcome Management. (Washington, DC: The Urban Institute, 2003) This is a clear no-nonsense step-by-step guide to conducting outcome evaluation that includes checklists, examples and other practical tools.
Wholey, Joseph S., Harry P. Hatry and Kathryn E. Newcomer, Ed. Handbook of Practical Program Evaluation (San Francisco, California: Jossey-Bass Publishers, 1994). Contains varied views and much useful insight into the process of program evaluation.
- Ask peers if they have used evaluators that served their program well.
- Look for professional evaluators on the American Evaluation Association Web site .
- Look for professors and students in colleges and universities to conduct the evaluation- particularly professional management schools and social science departments.
- Still looking? We might be able to help. Contact us.
|
