| |
| |
Preface | |
| |
| |
| |
Introduction to Evaluation | |
| |
| |
| |
Evaluation's Basic Purpose, Uses, and Conceptual Distinctions | |
| |
| |
A Brief Definition of Evaluation | |
| |
| |
Informal versus Formal Evaluation | |
| |
| |
Distinguishing between Evaluation's Purposes and Evaluators' Roles and Activities | |
| |
| |
Some Basic Types of Evaluation | |
| |
| |
Evaluation's Importance--and Its Limitations | |
| |
| |
| |
Origins and Current Trends in Modern Program Evaluation | |
| |
| |
The History and Influence of Evaluation in Society | |
| |
| |
Recent Trends Influencing Program Evaluation | |
| |
| |
| |
Alternative Approaches to Program Evaluation | |
| |
| |
| |
Alternative Views of Evaluation | |
| |
| |
Diverse Conceptions of Program Evaluation | |
| |
| |
Origins of Alternative Views of Evaluation | |
| |
| |
Themes among the Variations | |
| |
| |
A Classification Schema for Evaluation Approaches | |
| |
| |
| |
Objectives-Oriented Evaluation Approaches | |
| |
| |
Developers of the Objectives-Oriented Evaluation Approach and Their Contributions | |
| |
| |
How the Objectives-Oriented Evaluation Approach Has Been Used | |
| |
| |
Strengths and Limitations of the Objectives-Oriented Evaluation Approach | |
| |
| |
| |
Management-Oriented Evaluation Approaches | |
| |
| |
Developers of the Management-Oriented Evaluation Approach and Their Contributions | |
| |
| |
How the Management-Oriented Evaluation Approach Has Been Used | |
| |
| |
Strengths and Limitations of the Management-Oriented Evaluation Approach | |
| |
| |
| |
Consumer-Oriented Evaluation Approaches | |
| |
| |
Developers of the Consumer-Oriented Evaluation Approach and Their Contributions | |
| |
| |
How the Consumer-Oriented Evaluation Approach Has Been Used | |
| |
| |
Strengths and Limitations of the Consumer-Oriented Evaluation Approach | |
| |
| |
| |
Expertise-Oriented Evaluation Approaches | |
| |
| |
Developers of the Expertise-Oriented Evaluation Approach and Their Contributions | |
| |
| |
How the Expertise-Oriented Evaluation Approach Has Been Used | |
| |
| |
Strengths and Limitations of the Expertise-Oriented Evaluation Approach | |
| |
| |
| |
Participant-Oriented Evaluation Approaches | |
| |
| |
Evolution of Participant-Oriented Evaluation Approaches | |
| |
| |
Developers of the Participant-Oriented Evaluation Approach and Their Contributions | |
| |
| |
How Participant-Oriented Evaluation Approaches Have Been Used | |
| |
| |
Strengths and Limitations of Participant-Oriented Evaluation Approaches | |
| |
| |
| |
Alternative Evaluation Approaches: A Summary and Comparative Analysis | |
| |
| |
Cautions about the Alternative Evaluation Approaches | |
| |
| |
Contributions of the Alternative Evaluation Approaches | |
| |
| |
Comparative Analysis of Characteristics of Alternative Evaluation Approaches | |
| |
| |
Eclectic Uses of the Alternative Evaluation Approaches | |
| |
| |
Drawing Practical Implications from the Alternative Evaluation Approaches | |
| |
| |
| |
Practical Guidelines for Planning Evaluations | |
| |
| |
Introduction of Case Study | |
| |
| |
| |
Clarifying the Evaluation Request and Responsibilities | |
| |
| |
Understanding the Reasons for Initiating the Evaluation | |
| |
| |
Conditions under which Evaluation Studies Are Inappropriate | |
| |
| |
Determining When an Evaluation Is Appropriate: Evaluability Assessment | |
| |
| |
Using an Internal or External Evaluator | |
| |
| |
Hiring an Evaluator | |
| |
| |
How Different Evaluation Approaches Clarify the Evaluation Request and Responsibilities | |
| |
| |
| |
Setting Boundaries and Analyzing the Evaluation Context | |
| |
| |
Identifying Intended Audiences for an Evaluation | |
| |
| |
Describing What Is to Be Evaluated: Setting the Boundaries | |
| |
| |
Analyzing the Resources and Capabilities That Can Be Committed to the Evaluation | |
| |
| |
Analyzing the Political Context for the Evaluation | |
| |
| |
Variations Caused by the Evaluation Approach Used | |
| |
| |
Determining Whether to Proceed with the Evaluation | |
| |
| |
| |
Identifying and Selecting the Evaluation Questions and Criteria | |
| |
| |
Identifying Appropriate Sources of Questions and Criteria: The Divergent Phase | |
| |
| |
Selecting the Questions, Criteria, and Issues to Be Addressed: The Convergent Phase | |
| |
| |
Remaining Flexible during the Evaluation: Allowing New Questions, Criteria, and Standards to Emerge | |
| |
| |
| |
Planning How to Conduct the Evaluation | |
| |
| |
Identifying Design and Data Collection Methods | |
| |
| |
Specifying How the Evaluation Will Be Conducted: The Management Plan | |
| |
| |
Establishing Evaluation Agreements and Contracts | |
| |
| |
| |
Practical Guidelines for Conducting and Using Evaluations | |
| |
| |
| |
Collecting Evaluation Information: Design, Sampling, and Cost Choices | |
| |
| |
Using Mixed Methods | |
| |
| |
Designs for Collecting Causal and Descriptive Information | |
| |
| |
Sampling | |
| |
| |
Cost Analysis | |
| |
| |
| |
Collecting Evaluation Information: Data Sources and Methods, Analysis, and Interpretation | |
| |
| |
Common Sources and Methods for Collecting Information | |
| |
| |
Planning and Organizing the Collection of Information | |
| |
| |
Analysis of Data and Interpretation of Findings | |
| |
| |
| |
Reporting and Using Evaluation Information | |
| |
| |
Purposes of Evaluation Reports | |
| |
| |
Important Factors in Planning Evaluation Reports | |
| |
| |
Key Components of a Written Report | |
| |
| |
Suggestions for Presenting Information in Written Reports | |
| |
| |
Alternative Methods for Reporting: The Adversary Approach | |
| |
| |
Human and Humane Considerations in Reporting Evaluation Findings | |
| |
| |
Suggestions for Effective Oral Reporting | |
| |
| |
A Checklist for Good Evaluation Reports | |
| |
| |
How Evaluation Information Is Used | |
| |
| |
| |
Dealing with Political, Ethical, and Interpersonal Aspects of Evaluation | |
| |
| |
Establishing and Maintaining Good Communications among Evaluators and Stakeholders | |
| |
| |
Understanding Potential Bias Resulting from the Evaluator's Personal Values and Interpersonal, Financial, and Organizational Relationships with Others | |
| |
| |
Maintaining Ethical Standards: Considerations, Issues, and Responsibilities for Evaluators and Clients | |
| |
| |
Political Pressures and Problems in Evaluation | |
| |
| |
| |
Evaluating Evaluations | |
| |
| |
The Concept and Evolution of Metaevaluation | |
| |
| |
The Joint Committee's Standards for Program Evaluation | |
| |
| |
Summary of the Program Evaluation Standards | |
| |
| |
AEA Guiding Principles for Evaluators | |
| |
| |
The Role of Metaevaluator | |
| |
| |
Some General Guidelines for Conducting Metaevaluations | |
| |
| |
A Need for More Metaevaluation | |
| |
| |
| |
Emerging and Future Settings for Program Evaluation | |
| |
| |
| |
Conducting Multiple-Site Evaluation Studies | |
| |
| |
Purposes and Characteristics of Multiple-Site Evaluations | |
| |
| |
Multisite Evaluation (MSE) | |
| |
| |
On-Site Evaluation at Multiple Sites | |
| |
| |
Cluster Evaluation | |
| |
| |
Other Approaches to Multiple-Site Evaluation | |
| |
| |
| |
Conducting Evaluation of Organizations' Renewal and Training in Corporate and Nonprofit Settings | |
| |
| |
Evaluation in the Nonprofit Sector | |
| |
| |
Evaluating Corporate Training Programs | |
| |
| |
Personnel Evaluation | |
| |
| |
Other Methods of Organizational Assessment | |
| |
| |
| |
The Future of Evaluation | |
| |
| |
The Future of Evaluation | |
| |
| |
Predictions concerning the Profession of Evaluation | |
| |
| |
Predictions concerning the Practice of Evaluation | |
| |
| |
A Vision for Evaluation | |
| |
| |
Conclusion | |
| |
| |
Suggested Readings | |
| |
| |
| |
Evaluation-Related Web Sites | |
| |
| |
References | |
| |
| |
Author Index | |
| |
| |
Subject Index | |