Evaluation
Research References for Non-Researchers:
An Annotated Bibliography
©
1999 Education Development Center, Inc.
This
bibliography of selected resources on evaluation concepts for
practitioners was compiled by Social Science Research and Evaluation
(SSRE) and annotated by SSRE and the Northeast CAPT.
Publications
available through NCADI can be ordered using the publication number
provided by calling 1-800-729-6686, or by printing and faxing
a publications order form from the NCADI catalog, available at
http://www.health.org/pubs/catalog/index.htm
Andrews,
F.M., Lem, L., Davidson, T.N., O'Malley, P., Rodgers, W.L. (1978).
A Guide for Selecting Statistical Techniques for Analyzing
Social Science Data, Ann Arbor, Michigan: Survey Research
Center, Institute for Social Research, University of Michigan.
This
guide uses decision trees to map the choices involved in selecting
an appropriate statistical technique for a given analysis. More
than 100 different statistics or statistical techniques are
included in the guide. Some knowledge of statistics is assumed.
Brito,
C.S., Stewart, K., and Reynolds, R.I. (1998). Prevention Statistics
Made Easy: Understanding Correlation, Explained Variance and Causation.
Paper delivered at . Prevention Planning for Youth Substance Abuse
Initiatives,. 11th Thnnual National Prevention Network
Research Conference. San Antonio, TX.
This
brief paper provides an overview of four basic statistical concepts:
correlation, statistical significance, explained variance, and
causation. It is intended to help practitioners identify which
prevention findings are worth further consideration and which
indicate weaker results. Full text available online at: http://www.health.org/pubs/corella2.htm
Carmona,
M.C., Stewart, K., Gottfredson, D.C., Gottfredson, G.D. (1998).
A Guide for Evaluating Prevention Effectiveness, CSAP Technical
Report. Rockville, MD: U.S. Department of Health and Human
Services, Substance Abuse and Mental Health Services Administration,
Center for Substance Abuse Prevention.
This
guide provides practitioners with basic evaluation concepts
and tools. It describes commonly used research designs and their
strengths and weaknesses. Qualitative and quantitative data
collection methods used in process and outcome evaluation are
described. Basic concepts in data analysis are also discussed.
NCADI publication number: 98-3237
French,
J. F. and Kaufman, N. J. (Eds.) (1981). Handbook For Prevention
Evaluation: Prevention Evaluation Guidelines. Washington,
D.C.: National Institute on Drug Abuse, Publication No. ADM81-1145.
This
handbook was written for evaluator-practitioner teams working
to apply their skills in the assessment and improvement of prevention
programs. Topics discussed include models of prevention, evaluation
design, indicators and measures for process and outcome evaluation,
and reporting evaluation results. It contains an extensive appendix
on instruments and data sources.
Hawkins,
J.D. and Nederhood, B. (1987). Handbook for Evaluating Drug
and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention
Programs. Washington, D.C.: U.S. Department of Health and
Human Services, Publication No. (ADM) 87-1512.
This
handbook provides program managers with a comprehensive tool
to guide their evaluation efforts. It discusses instruments
and activities for determining program effectiveness (outcome
evaluation), and for documenting and monitoring the delivery
of services (process evaluation). The major topics it addresses
are evaluation design, measuring outcomes, measuring implementation,
data collection, data analysis, and reporting study findings.
Worksheets, sample instruments, and a bibliography are included.
Isaac,
S. and Michael, W.B. (1983). Handbook in Research and Evaluation
: A Collection of Principles, Methods, and Strategies Useful in
Planning, Design, and Evaluation of Studies in Education and the
Behavioral Sciences (Second Edition), San Diego, California:
EdLTS Publishers.
This
book summarizes basic information on research and evaluation
methods. It is intended to help practitioners choose the best
technique for a particular study. The major topics discussed
include planning evaluation and research studies, research design
and methods, instrumentation and measurement, data analysis,
and reporting a research study. It contains many tables and
worksheets.
W.K.
Kellogg Foundation. (1998). W. K. Kellogg Foundation Evaluation
Handbook. Battle Creek, Michigan: Collateral Management Company.
This
handbook provides a framework for thinking about evaluation
as a program tool. It was written for project directors with
direct responsibility for the evaluation of Kellogg Foundation-funded
projects. It discusses how to prepare for an evaluation (e.g.,
developing evaluation questions, budgeting for evaluation, selecting
an evaluator), designing and conducting an evaluation (e.g.,
data collection methods, analyzing and interpreting data), and
reporting findings. The handbook contains worksheets, charts
and a bibliography on evaluation. Full text available online
at: http://www.wkkf.org/documents/wkkf/evaluationhandbook/evalhandbook.pdf
Kozel
N.J., Sloboda Z. (1998). Assessing Drug Abuse Within and Across
Communities: Community Epidemiology Surveillance Networks on Drug
Abuse. Rockville, Maryland: National Institute on Drug Abuse,
NIH Publication No. 98-3614.
This
guidebook is meant to help practitioners at the local, regional,
and state level assess local drug abuse patterns and trends
using indicator data. The types of data sources discussed include:
treatment data, medical examiner/coroner data, the Drug Abuse
Warning Network (DAWN), law enforcement data, national surveys,
HIV/AIDS data, census data, and telephone hotline data. The
guidebook includes references, a glossary, and appendices that
identify or discuss data sources. Full text available online
at: http://www.nida.nih.gov/DEPR/Assessing/Guideindex.html
Larson,
M.J., Buckley, J. and Gabriel, R. M. (1997). A Community Substance
Abuse Indicator's Handbook: How Do We Know We Are Making a Difference?
Boston, Massachusetts: Join Together.
This
guide for communities describes indicators that community coalitions
and other groups can use to describe the nature and scope of
local substance abuse problems. The term "indicators"
refers to information that is usually already collected by an
agency or organization. The Guide discusses the sources and
interpretation of the data for 20 substance abuse indicators
(e.g., licensed alcohol outlets, arrests for driving, substance
abuse related hospital admissions). It includes contact information
on state agencies and organizations that collect/report indicator
data. This document can be ordered online at: http://www.jointogether.org/sa/
in the resources/publications section. A summary of this document
can be found in . Beyond Anecdote: Using Local Indicators to
Guide Your Community Strategy to Reduce Substance Abuse. 1999
Monthly Action Kit, Special 1999 Issue, Boston, Massachusetts:
Join Together, 1999.
Miller,
D. C. (1991). Handbook of Research Design and Social Measurement,
fifth edition. Newbury, Park, California: Sage Publications,
Inc.
This
handbook provides procedures and guidance for three major types
of research: basic, applied, and evaluation. Discussion includes
research design, data collection (documentary resources, questionnaires,
interviews), statistical analysis, and scales and indexes. It
includes a guide to federal and private funding and to the publication
of research reports. Extensive bibliographies follow each major
section of the handbook.
Moberg,
D. P. (1984). Evaluation of Prevention Programs: A Basic Guide
for Practitioners. Wisconsin: Board of Regents of the University
of Wisconsin System for the Wisconsin Clearinghouse.
This
guide is intended for practitioners involved in planning and
delivering local prevention services. Definitions and uses of
program evaluation are described. Recommended steps for planning
and implementing a program evaluation are detailed.
Muraskin,
L. D. (1993). Understanding Evaluation: The Way to Better Prevention
Programs. Washington, D.C.: U.S. Department of Education.
Publication # ED/OESE92-41.
This
handbook was written for school and community agency staff to
carry out required evaluations under the Drug-Free Schools and
Communities Act. The premise of this book is that many evaluations
that use simple designs can be conducted without formal training
in program evaluation. The author outlines checkpoints in the
evaluation process where practitioners may want to consult with
evaluation specialists. Topics discussed include evaluation
design, data collection methods and instruments, and interpreting
and reporting findings. The handbook describes implementation
of an evaluation of a hypothetical prevention program. This
publication can be ordered through ERIC at: http://www.ed.gov/pubs/pubdb.html
Thompson,
N.J. and McClintock, H.O. (1998). Demonstrating Your Program's
Worth: A Primer on Evaluation for Programs to Prevent Unintentional
Injury. Atlanta, GA: National Center for Injury Prevention
and Control, Centers for Disease Control and Prevention.
