| |
| |
About the Authors | |
| |
| |
Preface | |
| |
| |
Acknowledgments | |
| |
| |
| |
An Introduction to Interactive Evaluation Practice | |
| |
| |
| |
Introducing Interactive Evaluation Practice | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
Why It Pays to Pay Attention to Interpersonal Dynamics in Program Evaluation | |
| |
| |
The Personal and Interpersonal Factors | |
| |
| |
What Is Program Evaluation? What Is Interactive Evaluation Practice? | |
| |
| |
Evaluation Metaphysics | |
| |
| |
Three Roles of the Evaluator in Interactive Evaluations Practice | |
| |
| |
Evaluator as Decision Maker | |
| |
| |
Evaluator as Actor | |
| |
| |
Evaluator as Reflective Practitioner | |
| |
| |
Chapter Review | |
| |
| |
| |
Framing Interactive Evaluation Practice | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
A Primer on Seven Basic Inquiry Tasks | |
| |
| |
The Interpersonal Participation Quotient | |
| |
| |
Evaluator-Directed Studies | |
| |
| |
Collaborative Studies | |
| |
| |
Participant-Directed Studies | |
| |
| |
The Evaluation Capacity Building Framework | |
| |
| |
Applying the Frameworks to Evaluation Practice | |
| |
| |
| |
Accreditation for a Health Clinic | |
| |
| |
| |
Customer Satisfaction in the Hospitality Industry | |
| |
| |
| |
Organization Development in an Educational Institution | |
| |
| |
Chapter Review | |
| |
| |
| |
Theoretical Foundations for Interactive Evaluation Practice | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
Where's the Theory? | |
| |
| |
Factors Impeding Research on Evaluation Practice | |
| |
| |
Theories to Use in Interactive Evaluation Practice | |
| |
| |
Social Interdependence Theory | |
| |
| |
Theoretical Conceptions of Evaluation Use | |
| |
| |
Studying Evaluation Use | |
| |
| |
What Research Says About Evaluation Use | |
| |
| |
Theory-Based Principles for Interactive Evaluation Practice | |
| |
| |
Chapter Review | |
| |
| |
| |
Skills and Strategies for Interactive Evaluation Practice | |
| |
| |
| |
The Nuts and Bolts of Evaluation Conversations | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
The Role of Conversations in Evaluation Practice | |
| |
| |
How Program Evaluation Conversational Differ From Other Conversations | |
| |
| |
Context | |
| |
| |
The Client/Primary Intended User | |
| |
| |
Conversation Content | |
| |
| |
The Evaluator | |
| |
| |
Overarching Goals and Sample Questions for Evaluation Conversations | |
| |
| |
Conversations and the Interactive Evaluation Practice Frameworks | |
| |
| |
Applying Interactive Evaluation Practice Principles to Evaluation Conversations | |
| |
| |
Chapter Review | |
| |
| |
| |
An Evaluator's Dozen of Interactive Strategies | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
Grounding Interactive Evaluation Strategies | |
| |
| |
Why Use Interactive Strategies in Evaluation? | |
| |
| |
Where Will Interactive Evaluation Strategies Work Best? | |
| |
| |
When Should Evaluators Use Interactive Evaluation Strategies? | |
| |
| |
How Can Interactive Strategies Be Facilitated? | |
| |
| |
Facilitating Interactive Evaluation Strategies | |
| |
| |
Interactive Evaluation Strategies | |
| |
| |
An Example of the Strategies in Action | |
| |
| |
Practical Considerations for Using Interactive Strategies | |
| |
| |
Applying Interactive Evaluation Practice Principles to Interactive Strategies | |
| |
| |
Chapter Review | |
| |
| |
| |
Managing Conflict Constructively in Evaluation Settings | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
Recognizing Conflict in Evaluation Practice | |
| |
| |
Theoretical Frameworks for Constructive Conflict Resolution | |
| |
| |
Conflict Strategies Theory | |
| |
| |
Constructive Conflict Resolution Theory | |
| |
| |
Skills for Constructive Conflict Resolution | |
| |
| |
Structure Cooperative Goals | |
| |
| |
Negotiate for Mutual Gain | |
| |
| |
Conflict Competencies for Evaluators | |
| |
| |
Analyze the Social Context | |
| |
| |
Goal Structures | |
| |
| |
Cooperative Interaction | |
| |
| |
Conflict Situations | |
| |
| |
Recognize Conflict Behaviors | |
| |
| |
Forcing | |
| |
| |
Withdrawing | |
| |
| |
Smoothing | |
| |
| |
Compromising | |
| |
| |
Facilitate Mutual Problem Solving | |
| |
| |
Create Cooperative Norms | |
| |
| |
Know Thyself | |
| |
| |
Applying Interactive Evaluation Practice Principles to Managing Conflict Constructively | |
| |
| |
Chapter Review | |
| |
| |
| |
Creating a Viable Interactive Evaluation Process | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
Planning a Viable Interactive Evaluation Process | |
| |
| |
Context/Setting | |
| |
| |
Culture | |
| |
| |
Involvement | |
| |
| |
Establish Committees | |
| |
| |
Populate Committees | |
| |
| |
Analyze Attitude and Aptitude | |
| |
| |
Logistics | |
| |
| |
Establish Consistent Expectations, Procedures, and Routines | |
| |
| |
Focus on Meetings | |
| |
| |
Create and Use Templates | |
| |
| |
Organize Systems for Dealing With Documents | |
| |
| |
Determine Who Will Manage Logistics | |
| |
| |
Communication | |
| |
| |
Communication Within Evaluation Committees | |
| |
| |
Communication Among Evaluation Committees | |
| |
| |
Communication Beyond Evaluation Committees | |
| |
| |
Electronic Communication | |
| |
| |
Information Management | |
| |
| |
Confidentiality | |
| |
| |
Building Evaluation Capacity Through Interactive Processes | |
| |
| |
Organizational Context | |
| |
| |
ECB-Friendly Internal Organizational Context | |
| |
| |
Support From the External Environment | |
| |
| |
Resources | |
| |
| |
Access to Evaluation Resources | |
| |
| |
Sources of Organizational Support for Evaluation | |
| |
| |
ECB Structures | |
| |
| |
Long-Term Plan for ECB | |
| |
| |
Infrastructure to Support the Evaluation Process | |
| |
| |
Purposeful Socialization Into the Evaluation Process | |
| |
| |
Peer Learning Structures | |
| |
| |
Assessing Evaluation Processes to Enhance Viability | |
| |
| |
Applying Interactive Evaluation Practice Principles to Creating a Viable Interactive Evaluation Process | |
| |
| |
Chapter Review | |
| |
| |
| |
Dealing With the Unexpected in Program Evaluation: When Bad Things Happen to Good Evaluators | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
The Limits of Evaluation Practice | |
| |
| |
What Can Go Wrong During a Program Evaluation? | |
| |
| |
Environmental Issues | |
| |
| |
Environmental Scenario | |
| |
| |
Client/User Issues | |
| |
| |
Client/User Scenario | |
| |
| |
Evaluation Process/Results Issues | |
| |
| |
Evaluation Process/Results Scenario | |
| |
| |
Evaluator Issues | |
| |
| |
Evaluator Issues Scenario | |
| |
| |
What Can Interactive Evaluators Do When Bad Things Happen? | |
| |
| |
General Responses to Unexpected Issues | |
| |
| |
Environmental Issues | |
| |
| |
Client/User Issues | |
| |
| |
Evaluation Process/Results Issues | |
| |
| |
Evaluator Issues | |
| |
| |
Putting It All Together | |
| |
| |
The Role of Internal Versus External Evaluators in Addressing the Unexpected | |
| |
| |
Internal Evaluators | |
| |
| |
External Evaluators | |
| |
| |
Thinking About Inevitable Trade-Offs in Evaluation Decision Making | |
| |
| |
Applying Interactive Evaluation Practice Principles to Dealing With the Unexpected in Program Evaluation | |
| |
| |
Chapter Review | |
| |
| |
| |
Teaching Cases For Bringing Interactive Evaluation Practice To Life | |
| |
| |
| |
The Evaluator Is in Charge: Evaluating a Controversial Shelter Project | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
The Evaluation Context | |
| |
| |
The Cast of Characters as the Evaluation Began | |
| |
| |
The Evaluation Process | |
| |
| |
Initial Decisions/Actions | |
| |
| |
Data Collection and Analysis Decisions/Actions | |
| |
| |
Data Interpretation and Reporting Decisions/Actions | |
| |
| |
Case Study TIPS: Think, Interact, Practice, Situate | |
| |
| |
Chapter Review | |
| |
| |
| |
We're in This Together: Evaluating a Remedial Math Program | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
The Evaluation Context | |
| |
| |
The Cast of Characters as the Evaluation Began | |
| |
| |
The Evaluation Process | |
| |
| |
Initial Decisions/Actions | |
| |
| |
Data Collection and Analysis Decisions/Actions | |
| |
| |
Data Interpretation and Reporting Decisions/Actions | |
| |
| |
Case Study TIPS: Think, Interact, Practice, Situate | |
| |
| |
Chapter Review | |
| |
| |
| |
Serving as an Evaluation Coach: Engaging Staff and Participants in Evaluating a Healthy Nutrition Program | |
| |
| |
Chapter Preview | |
| |
| |
Introduction | |
| |
| |
The Evaluation Context | |
| |
| |
The Cast of Characters as the Evaluation Began | |
| |
| |
The Evaluation Process | |
| |
| |
Initial Decisions/Actions | |
| |
| |
Data Collection and Analysis Decisions/Actions | |
| |
| |
Data Interpretation and Reporting Decisions/Actions | |
| |
| |
Case Study TIPS: Think, Interact, Practice, Situate | |
| |
| |
Chapter Review | |
| |
| |
Epilogue: The End-and a Beginning | |
| |
| |
Glossary | |
| |
| |
| |
The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users (3rd Edition) | |
| |
| |
| |
American Evaluation Association Guiding Principles for Evaluators | |
| |
| |
| |
Essential Competencies for Program Evaluators | |
| |
| |
| |
Interactive Evaluation Practice Principles Chapter Crosswalk | |
| |
| |
| |
Generic Exercises for Reflecting on Interactive Evaluation Practice Case Studies | |
| |
| |
References | |
| |
| |
Author Index | |
| |
| |
Subject Index | |