| |
| |
| Preface | |
| |
| |
| |
| Introduction to Evaluation | |
| |
| |
| |
| Evaluation's Basic Purpose, Uses, and Conceptual Distinctions | |
| |
| |
| A Brief Definition of Evaluation | |
| |
| |
| Informal versus Formal Evaluation | |
| |
| |
| Distinguishing between Evaluation's Purposes and Evaluators' Roles and Activities | |
| |
| |
| Some Basic Types of Evaluation | |
| |
| |
| Evaluation's Importance--and Its Limitations | |
| |
| |
| |
| Origins and Current Trends in Modern Program Evaluation | |
| |
| |
| The History and Influence of Evaluation in Society | |
| |
| |
| Recent Trends Influencing Program Evaluation | |
| |
| |
| |
| Alternative Approaches to Program Evaluation | |
| |
| |
| |
| Alternative Views of Evaluation | |
| |
| |
| Diverse Conceptions of Program Evaluation | |
| |
| |
| Origins of Alternative Views of Evaluation | |
| |
| |
| Themes among the Variations | |
| |
| |
| A Classification Schema for Evaluation Approaches | |
| |
| |
| |
| Objectives-Oriented Evaluation Approaches | |
| |
| |
| Developers of the Objectives-Oriented Evaluation Approach and Their Contributions | |
| |
| |
| How the Objectives-Oriented Evaluation Approach Has Been Used | |
| |
| |
| Strengths and Limitations of the Objectives-Oriented Evaluation Approach | |
| |
| |
| |
| Management-Oriented Evaluation Approaches | |
| |
| |
| Developers of the Management-Oriented Evaluation Approach and Their Contributions | |
| |
| |
| How the Management-Oriented Evaluation Approach Has Been Used | |
| |
| |
| Strengths and Limitations of the Management-Oriented Evaluation Approach | |
| |
| |
| |
| Consumer-Oriented Evaluation Approaches | |
| |
| |
| Developers of the Consumer-Oriented Evaluation Approach and Their Contributions | |
| |
| |
| How the Consumer-Oriented Evaluation Approach Has Been Used | |
| |
| |
| Strengths and Limitations of the Consumer-Oriented Evaluation Approach | |
| |
| |
| |
| Expertise-Oriented Evaluation Approaches | |
| |
| |
| Developers of the Expertise-Oriented Evaluation Approach and Their Contributions | |
| |
| |
| How the Expertise-Oriented Evaluation Approach Has Been Used | |
| |
| |
| Strengths and Limitations of the Expertise-Oriented Evaluation Approach | |
| |
| |
| |
| Participant-Oriented Evaluation Approaches | |
| |
| |
| Evolution of Participant-Oriented Evaluation Approaches | |
| |
| |
| Developers of the Participant-Oriented Evaluation Approach and Their Contributions | |
| |
| |
| How Participant-Oriented Evaluation Approaches Have Been Used | |
| |
| |
| Strengths and Limitations of Participant-Oriented Evaluation Approaches | |
| |
| |
| |
| Alternative Evaluation Approaches: A Summary and Comparative Analysis | |
| |
| |
| Cautions about the Alternative Evaluation Approaches | |
| |
| |
| Contributions of the Alternative Evaluation Approaches | |
| |
| |
| Comparative Analysis of Characteristics of Alternative Evaluation Approaches | |
| |
| |
| Eclectic Uses of the Alternative Evaluation Approaches | |
| |
| |
| Drawing Practical Implications from the Alternative Evaluation Approaches | |
| |
| |
| |
| Practical Guidelines for Planning Evaluations | |
| |
| |
| Introduction of Case Study | |
| |
| |
| |
| Clarifying the Evaluation Request and Responsibilities | |
| |
| |
| Understanding the Reasons for Initiating the Evaluation | |
| |
| |
| Conditions under which Evaluation Studies Are Inappropriate | |
| |
| |
| Determining When an Evaluation Is Appropriate: Evaluability Assessment | |
| |
| |
| Using an Internal or External Evaluator | |
| |
| |
| Hiring an Evaluator | |
| |
| |
| How Different Evaluation Approaches Clarify the Evaluation Request and Responsibilities | |
| |
| |
| |
| Setting Boundaries and Analyzing the Evaluation Context | |
| |
| |
| Identifying Intended Audiences for an Evaluation | |
| |
| |
| Describing What Is to Be Evaluated: Setting the Boundaries | |
| |
| |
| Analyzing the Resources and Capabilities That Can Be Committed to the Evaluation | |
| |
| |
| Analyzing the Political Context for the Evaluation | |
| |
| |
| Variations Caused by the Evaluation Approach Used | |
| |
| |
| Determining Whether to Proceed with the Evaluation | |
| |
| |
| |
| Identifying and Selecting the Evaluation Questions and Criteria | |
| |
| |
| Identifying Appropriate Sources of Questions and Criteria: The Divergent Phase | |
| |
| |
| Selecting the Questions, Criteria, and Issues to Be Addressed: The Convergent Phase | |
| |
| |
| Remaining Flexible during the Evaluation: Allowing New Questions, Criteria, and Standards to Emerge | |
| |
| |
| |
| Planning How to Conduct the Evaluation | |
| |
| |
| Identifying Design and Data Collection Methods | |
| |
| |
| Specifying How the Evaluation Will Be Conducted: The Management Plan | |
| |
| |
| Establishing Evaluation Agreements and Contracts | |
| |
| |
| |
| Practical Guidelines for Conducting and Using Evaluations | |
| |
| |
| |
| Collecting Evaluation Information: Design, Sampling, and Cost Choices | |
| |
| |
| Using Mixed Methods | |
| |
| |
| Designs for Collecting Causal and Descriptive Information | |
| |
| |
| Sampling | |
| |
| |
| Cost Analysis | |
| |
| |
| |
| Collecting Evaluation Information: Data Sources and Methods, Analysis, and Interpretation | |
| |
| |
| Common Sources and Methods for Collecting Information | |
| |
| |
| Planning and Organizing the Collection of Information | |
| |
| |
| Analysis of Data and Interpretation of Findings | |
| |
| |
| |
| Reporting and Using Evaluation Information | |
| |
| |
| Purposes of Evaluation Reports | |
| |
| |
| Important Factors in Planning Evaluation Reports | |
| |
| |
| Key Components of a Written Report | |
| |
| |
| Suggestions for Presenting Information in Written Reports | |
| |
| |
| Alternative Methods for Reporting: The Adversary Approach | |
| |
| |
| Human and Humane Considerations in Reporting Evaluation Findings | |
| |
| |
| Suggestions for Effective Oral Reporting | |
| |
| |
| A Checklist for Good Evaluation Reports | |
| |
| |
| How Evaluation Information Is Used | |
| |
| |
| |
| Dealing with Political, Ethical, and Interpersonal Aspects of Evaluation | |
| |
| |
| Establishing and Maintaining Good Communications among Evaluators and Stakeholders | |
| |
| |
| Understanding Potential Bias Resulting from the Evaluator's Personal Values and Interpersonal, Financial, and Organizational Relationships with Others | |
| |
| |
| Maintaining Ethical Standards: Considerations, Issues, and Responsibilities for Evaluators and Clients | |
| |
| |
| Political Pressures and Problems in Evaluation | |
| |
| |
| |
| Evaluating Evaluations | |
| |
| |
| The Concept and Evolution of Metaevaluation | |
| |
| |
| The Joint Committee's Standards for Program Evaluation | |
| |
| |
| Summary of the Program Evaluation Standards | |
| |
| |
| AEA Guiding Principles for Evaluators | |
| |
| |
| The Role of Metaevaluator | |
| |
| |
| Some General Guidelines for Conducting Metaevaluations | |
| |
| |
| A Need for More Metaevaluation | |
| |
| |
| |
| Emerging and Future Settings for Program Evaluation | |
| |
| |
| |
| Conducting Multiple-Site Evaluation Studies | |
| |
| |
| Purposes and Characteristics of Multiple-Site Evaluations | |
| |
| |
| Multisite Evaluation (MSE) | |
| |
| |
| On-Site Evaluation at Multiple Sites | |
| |
| |
| Cluster Evaluation | |
| |
| |
| Other Approaches to Multiple-Site Evaluation | |
| |
| |
| |
| Conducting Evaluation of Organizations' Renewal and Training in Corporate and Nonprofit Settings | |
| |
| |
| Evaluation in the Nonprofit Sector | |
| |
| |
| Evaluating Corporate Training Programs | |
| |
| |
| Personnel Evaluation | |
| |
| |
| Other Methods of Organizational Assessment | |
| |
| |
| |
| The Future of Evaluation | |
| |
| |
| The Future of Evaluation | |
| |
| |
| Predictions concerning the Profession of Evaluation | |
| |
| |
| Predictions concerning the Practice of Evaluation | |
| |
| |
| A Vision for Evaluation | |
| |
| |
| Conclusion | |
| |
| |
| Suggested Readings | |
| |
| |
| |
| Evaluation-Related Web Sites | |
| |
| |
| References | |
| |
| |
| Author Index | |
| |
| |
| Subject Index | |