| |
| |
Foreword | |
| |
| |
Preface | |
| |
| |
Acknowledgments | |
| |
| |
| |
Case Study Methodology | |
| |
| |
| |
Introduction | |
| |
| |
| |
What is a Case Study? | |
| |
| |
| |
A Brief History of Case Studies in Software Engineering | |
| |
| |
| |
Why a Book on Case Studies of Software Engineering? | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Background and Definition of Concepts | |
| |
| |
| |
Introduction | |
| |
| |
| |
Research Strategies | |
| |
| |
| |
Characteristics of Research Strategies | |
| |
| |
| |
Purpose | |
| |
| |
| |
Control and Data | |
| |
| |
| |
Triangulation | |
| |
| |
| |
Replication | |
| |
| |
| |
Inductive and Deductive Enquiries | |
| |
| |
| |
What Makes a Good Case Study? | |
| |
| |
| |
When is the Case Study Strategy Feasible? | |
| |
| |
| |
Case Study Research Process | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Design of the Case Study | |
| |
| |
| |
Introduction | |
| |
| |
| |
Elements of the Case Study Design | |
| |
| |
| |
Rationale for the Study | |
| |
| |
| |
Objective of the Study | |
| |
| |
| |
Cases and Units of Analyses | |
| |
| |
| |
Theoretical Framework | |
| |
| |
| |
Research Questions | |
| |
| |
| |
Propositions and Hypotheses | |
| |
| |
| |
Concepts | |
| |
| |
| |
Methods of Data Collection | |
| |
| |
| |
Methods of Data Analysis | |
| |
| |
| |
Case Selection | |
| |
| |
| |
Selection of Data | |
| |
| |
| |
Data Definition and Data Storage | |
| |
| |
| |
Quality Control and Assurance | |
| |
| |
| |
Maintaining the Case Study Protocol | |
| |
| |
| |
Reporting and Disseminating the Case Study | |
| |
| |
| |
Legal, Ethical, and Professional Issues | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Introduction | |
| |
| |
| |
Different Types of Data Source | |
| |
| |
| |
Classification of Data Sources | |
| |
| |
| |
Data Source Selection | |
| |
| |
| |
Interviews | |
| |
| |
| |
Planning Interviews | |
| |
| |
| |
The Interview Session | |
| |
| |
| |
Postinterview Activities | |
| |
| |
| |
Focus groups | |
| |
| |
| |
Observations | |
| |
| |
| |
Archival Data | |
| |
| |
| |
Metrics | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Data Analysis and Interpretation | |
| |
| |
| |
Introduction | |
| |
| |
| |
Analysis of Data in Flexible Research | |
| |
| |
| |
Introduction | |
| |
| |
| |
Level of Formalism | |
| |
| |
| |
Relation to Hypotheses | |
| |
| |
| |
Process for Qualitative Data Analysis | |
| |
| |
| |
Introduction | |
| |
| |
| |
Steps in the Analysis | |
| |
| |
| |
Techniques | |
| |
| |
| |
Tool support | |
| |
| |
| |
Validity | |
| |
| |
| |
Construct Validity | |
| |
| |
| |
Internal Validity | |
| |
| |
| |
External Validity | |
| |
| |
| |
Reliability | |
| |
| |
| |
Improving Validity | |
| |
| |
| |
Quantitative Data Analysis | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Reporting and Dissemination | |
| |
| |
| |
Introduction | |
| |
| |
| |
Why Report and Disseminate | |
| |
| |
| |
The Audience for the Report | |
| |
| |
| |
Aspects of the Case Study to Report and Disseminate | |
| |
| |
| |
When to Report and Disseminate | |
| |
| |
| |
Guidelines on Reporting | |
| |
| |
| |
The Generic Content of an Academic Report | |
| |
| |
| |
Reporting Recommendations from Evaluative Case Studies | |
| |
| |
| |
Reporting to Stakeholders, Including Sponsor(s) | |
| |
| |
| |
Reporting the Context of the Case Study | |
| |
| |
| |
Reporting to Students | |
| |
| |
| |
Ad Hoc and Impromptu Reporting | |
| |
| |
| |
Formats and Structures for a Report | |
| |
| |
| |
Where to Report | |
| |
| |
| |
Ethics and Confidentiality | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Scaling Up Case Study Research to Real-World Software Practice | |
| |
| |
| |
Introduction | |
| |
| |
| |
The Aims of Scaling up Case Studies | |
| |
| |
| |
Dimensions of Scale | |
| |
| |
| |
Longitudinal Case Studies | |
| |
| |
| |
Multiple Case Studies | |
| |
| |
| |
Multiple Cases and Replications | |
| |
| |
| |
Selecting the Cases | |
| |
| |
| |
Multiresearcher Case Studies | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Using Case Study Research | |
| |
| |
| |
Introduction | |
| |
| |
| |
Reading and Reviewing Case Studies | |
| |
| |
| |
Development of Checklists | |
| |
| |
| |
Checklists for Conducting Case Study Research | |
| |
| |
| |
Checklists for Reading and Reviewing Case Studies | |
| |
| |
| |
Development of Practice | |
| |
| |
| |
Identifying and Synthesizing Use Case Research | |
| |
| |
| |
Identifying Primary Studies | |
| |
| |
| |
Synthesis of Evidence from Multiple Case Studies | |
| |
| |
| |
Current State of Synthesis | |
| |
| |
| |
The Economics of Case Study Research | |
| |
| |
| |
Costs and Benefits of Evaluation Techniques | |
| |
| |
| |
Evaluation of the DESMET Methodology | |
| |
| |
| |
Frameworks for Organizing Methods of Evaluation | |
| |
| |
| |
Specializing Case Study Research for Software Engineering | |
| |
| |
| |
The Longitudinal Chronological Case Study Research Strategy | |
| |
| |
| |
Controlled Case Studies | |
| |
| |
| |
Case Studies and Software Process Improvement | |
| |
| |
| |
Conclusion | |
| |
| |
| |
Examples of Case Studies | |
| |
| |
| |
Introduction to Case Study Examples | |
| |
| |
| |
Introduction | |
| |
| |
| |
Case Study of Extreme Programming in a Stage�Gate Context | |
| |
| |
| |
Introduction | |
| |
| |
| |
Methodological Status | |
| |
| |
| |
Case Study Design | |
| |
| |
| |
Rationale | |
| |
| |
| |
Objectives | |
| |
| |
| |
Cases and Units of Analysis | |
| |
| |
| |
Theoretical Frame of Reference | |
| |
| |
| |
Research Questions | |
| |
| |
| |
Planning | |
| |
| |
| |
Methods of Data Collection | |
| |
| |
| |
Selection of Data | |
| |
| |
| |
Case Selection Strategy | |
| |
| |
| |
Case Study Protocol | |
| |
| |
| |
Ethical Considerations | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Data Analysis | |
| |
| |
| |
Threats to Validity | |
| |
| |
| |
Reporting | |
| |
| |
| |
Academics | |
| |
| |
| |
Practitioners | |
| |
| |
| |
Lessons Learned | |
| |
| |
| |
Two Longitudinal Case Studies of Software Project Management | |
| |
| |
| |
Introduction | |
| |
| |
| |
Background to the Research Project | |
| |
| |
| |
Case Study Design and Planning | |
| |
| |
| |
Rationale | |
| |
| |
| |
Objective | |
| |
| |
| |
Definition of the Case | |
| |
| |
| |
Units of Analyses | |
| |
| |
| |
Theoretical Frame of Reference and Research Questions | |
| |
| |
| |
Case Selection | |
| |
| |
| |
Replication Strategy | |
| |
| |
| |
Case Study Protocol | |
| |
| |
| |
Quality Assurance, Validity, and Reliability | |
| |
| |
| |
Legal, Ethical, and Professional Considerations | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Sources of Data | |
| |
| |
| |
Data Analysis | |
| |
| |
| |
Reporting | |
| |
| |
| |
Internal Reporting of Results | |
| |
| |
| |
Dissemination of Artifacts | |
| |
| |
| |
Lessons Learned | |
| |
| |
| |
An Iterative Case Study of Quality Monitoring | |
| |
| |
| |
Introduction | |
| |
| |
| |
Case Study Design | |
| |
| |
| |
Objectives | |
| |
| |
| |
Cases and Units of Analysis | |
| |
| |
| |
Theoretical Frame of Reference | |
| |
| |
| |
Research Questions | |
| |
| |
| |
Planning | |
| |
| |
| |
Methods of Data Collection | |
| |
| |
| |
Case Selection Strategy | |
| |
| |
| |
Case Study Protocol | |
| |
| |
| |
Ethical Considerations | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Exploratory Study | |
| |
| |
| |
Confirmatory Study | |
| |
| |
| |
Explanatory Study | |
| |
| |
| |
Data Analysis | |
| |
| |
| |
Reporting | |
| |
| |
| |
Lessons Learned | |
| |
| |
| |
A Case Study of the Evaluation of Requirements Management Tools | |
| |
| |
| |
Introduction | |
| |
| |
| |
Design of the Case Study | |
| |
| |
| |
Rationale | |
| |
| |
| |
Objective | |
| |
| |
| |
The Case and Its Context | |
| |
| |
| |
The Units of Analyses | |
| |
| |
| |
Theoretical Framework | |
| |
| |
| |
Research Questions | |
| |
| |
| |
Propositions, Concepts, and Measures | |
| |
| |
| |
Case Study Protocol | |
| |
| |
| |
Methods of Data Collection | |
| |
| |
| |
Methods of Data Analysis | |
| |
| |
| |
Case Selection Strategy | |
| |
| |
| |
Data Selection Strategy | |
| |
| |
| |
Replication Strategy | |
| |
| |
| |
Quality Assurance, Validity, and Reliability | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Data Analysis | |
| |
| |
| |
Reporting and Dissemination | |
| |
| |
| |
Lessons Learned | |
| |
| |
| |
A Large-Scale Case Study of Requirements and Verification Alignment | |
| |
| |
| |
Introduction | |
| |
| |
| |
Case Study Design | |
| |
| |
| |
Rationale | |
| |
| |
| |
Objectives | |
| |
| |
| |
Cases and Units of Analysis | |
| |
| |
| |
Theoretical Frame of Reference | |
| |
| |
| |
Research Questions | |
| |
| |
| |
Planning | |
| |
| |
| |
Methods of Data Collection | |
| |
| |
| |
Case Selection Strategy | |
| |
| |
| |
Selection of Data | |
| |
| |
| |
Case Study Protocol | |
| |
| |
| |
Ethical Considerations | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Data Analysis | |
| |
| |
| |
Lessons Learned | |
| |
| |
| |
Effort Estimation Lessons | |
| |
| |
| |
Design and Planning Lessons | |
| |
| |
| |
Data Collection Lessons | |
| |
| |
| |
Data Analysis Lessons | |
| |
| |
| |
Reporting Lessons | |
| |
| |
| |
A General Lesson | |
| |
| |
Epilogue | |
| |
| |
| |
Checklists for Reading and Reviewing Case Studies | |
| |
| |
| |
Design of the Case Study | |
| |
| |
| |
Data Collection | |
| |
| |
| |
Data Analysis and Interpretation | |
| |
| |
| |
Reporting and Dissemination | |
| |
| |
| |
Reader�s Checklist | |
| |
| |
Example Interview Instrument (XP) | |
| |
| |
Example Interview Instrument (REVV) | |
| |
| |
Example of a Coding Guide | |
| |
| |
Coding Instructions | |
| |
| |
Codes | |
| |
| |
High Level Codes: Research Questions | |
| |
| |
Medium Level Codes: Categories | |
| |
| |
Coding Example | |
| |
| |
Example of a Consent Information Letter | |