| |
| |
List of Figures and Tables | |
| |
| |
Preface | |
| |
| |
Acknowledgments | |
| |
| |
| |
Background and Context of Evaluation | |
| |
| |
| |
Defining Evaluation | |
| |
| |
What Evaluation Is and Isn't | |
| |
| |
The Relationship Between Evaluation and Research | |
| |
| |
What Can Be Evaluated? | |
| |
| |
Why Evaluate? | |
| |
| |
Top Ten Reasons Evaluation Is Neglected | |
| |
| |
Kinds of Evaluations | |
| |
| |
Formative Evaluation | |
| |
| |
Summative Evaluation | |
| |
| |
The Logic of Evaluation | |
| |
| |
Evaluation Use | |
| |
| |
Internal and External Evaluation | |
| |
| |
Internal Evaluation and Evaluators | |
| |
| |
| |
The Evolution of Evaluation | |
| |
| |
The Role of Evaluation in Today's Organizations | |
| |
| |
The (Really) Early Days of Evaluation | |
| |
| |
The Transformation of Evaluation into a Profession | |
| |
| |
Types of Evaluation Models and Approaches | |
| |
| |
The Role of Evaluation in Today's Organizations | |
| |
| |
| |
Evaluating Learning, Performance, and Change Initiatives | |
| |
| |
Future Directions for Evaluating Learning, Performance, and Change | |
| |
| |
The Role of the Learning, Performance, and Change Professional | |
| |
| |
General Models, Approaches, and Taxonomies for Evaluation Training and Performance | |
| |
| |
Research on Training Program Evaluation Models | |
| |
| |
Future Directions for Evaluating Learning, Performance, and Change | |
| |
| |
| |
The Politics and Ethics of Evaluation Practice | |
| |
| |
Ways in Which Evaluation Becomes Political | |
| |
| |
Political Influences During the Evaluation | |
| |
| |
Examples of Evaluation Politics | |
| |
| |
Strategies for Managing the Politics of Evaluation | |
| |
| |
The Ethics of Evaluation Practice | |
| |
| |
| |
Designing and Implementing the Evaluation | |
| |
| |
| |
Focusing the Evaluation | |
| |
| |
Developing an Evaluation Plan | |
| |
| |
Developing the Evaluation's Rationale and Purpose | |
| |
| |
Developing Key Evaluation Questions | |
| |
| |
| |
Selecting an Evaluation Design | |
| |
| |
Basic Design Issues | |
| |
| |
Commonly Used Evaluation Designs | |
| |
| |
| |
Choosing Data Collection Methods | |
| |
| |
Menu of Data Collection Methods | |
| |
| |
Considerations for Choosing Data Collection Methods | |
| |
| |
Using Multiple Data Collection Methods | |
| |
| |
| |
Observation and Archival Data | |
| |
| |
Using Methods of Observation | |
| |
| |
Observer Roles | |
| |
| |
Collecting and Recording Observation Data | |
| |
| |
Conducting Observations | |
| |
| |
Advantages and Disadvantages of Collecting Observation Data | |
| |
| |
Collecting Archival Data--Records and Documents | |
| |
| |
Advantages and Disadvantages of Collecting Archival Data | |
| |
| |
| |
Surveys and Questionnaires | |
| |
| |
Types of Surveys | |
| |
| |
Guidelines for Constructing Surveys | |
| |
| |
Format Considerations | |
| |
| |
Pilot Testing the Items and Surveys | |
| |
| |
Summary of Steps in Survey Construction | |
| |
| |
Logistics | |
| |
| |
Handling Nonresponse Bias | |
| |
| |
Managing the Data Collection Process | |
| |
| |
Electronic Surveys | |
| |
| |
| |
Individual and Focus Group Interviews | |
| |
| |
Types of Interviews | |
| |
| |
Determining Which Interview Approach to Use | |
| |
| |
Advantages of Individual and Focus Group Interviews | |
| |
| |
Guidelines for Constructing Individual and Focus Group Interview Guides | |
| |
| |
Guidelines for Conducting Individual and Focus Group Interviews | |
| |
| |
The Interviewer's Role | |
| |
| |
Selecting and Training Interviewers | |
| |
| |
Managing the Interview Process | |
| |
| |
Computer-Aided Interviewing | |
| |
| |
| |
Sampling | |
| |
| |
Approaches to Sampling | |
| |
| |
Sampling Procedures | |
| |
| |
Issues to Consider When Selecting a Sample | |
| |
| |
| |
Analyzing Evaluation Data | |
| |
| |
Basic Considerations for Analyzing Data | |
| |
| |
Approaches to Qualitative Data Analysis | |
| |
| |
Approaches to Quantitative Data Analysis | |
| |
| |
Economic Analyses of Learning, Performance, and Change Interventions | |
| |
| |
Potential Problems in Analyzing Data | |
| |
| |
| |
Maximizing Evaluation Use | |
| |
| |
| |
Communicating and Reporting Evaluation Activities and Findings | |
| |
| |
| |
Purposes of Communicating and Reporting | |
| |
| |
Audiences for Communicating and Reporting | |
| |
| |
Timing of Communicating and Reporting | |
| |
| |
Content for Communicating and Reporting | |
| |
| |
Formats for Communicating and Reporting | |
| |
| |
| |
Planning, Managing, and Budgeting the Evaluation | |
| |
| |
Planning the Evaluation | |
| |
| |
Managing the Evaluation | |
| |
| |
Developing an Evaluation Budget | |
| |
| |
| |
Evaluating the Evaluation | |
| |
| |
Focusing the Evaluation | |
| |
| |
Implementing the Evaluation | |
| |
| |
Managing the Evaluation | |
| |
| |
Communicating and Reporting the Evaluation's Activities and Findings | |
| |
| |
| |
Strategies for Implementing Evaluation in Organizations | |
| |
| |
Gaining Commitment and Support for Evaluation Work | |
| |
| |
Using Participatory and Collaborative Approaches | |
| |
| |
Understanding the Evaluation Context | |
| |
| |
Engaging in Evaluation Professional Development | |
| |
| |
Choosing an Evaluator Role | |
| |
| |
| |
The Readiness for Organizational Learning and Evaluation Instrument (ROLE) | |
| |
| |
References | |
| |
| |
Index | |
| |
| |
About the Authors | |