Per Runeson, Martin Host, Austen Rainer, Bjorn Regnell
Case Study Research in Software Engineering (eBook, PDF)
Guidelines and Examples
Schade – dieser Artikel ist leider ausverkauft. Sobald wir wissen, ob und wann der Artikel wieder verfügbar ist, informieren wir Sie an dieser Stelle.
Per Runeson, Martin Host, Austen Rainer, Bjorn Regnell
Case Study Research in Software Engineering (eBook, PDF)
Guidelines and Examples
- Format: PDF
- Merkliste
- Auf die Merkliste
- Bewerten Bewerten
- Teilen
- Produkt teilen
- Produkterinnerung
- Produkterinnerung
Bitte loggen Sie sich zunächst in Ihr Kundenkonto ein oder registrieren Sie sich bei
bücher.de, um das eBook-Abo tolino select nutzen zu können.
Hier können Sie sich einloggen
Hier können Sie sich einloggen
Sie sind bereits eingeloggt. Klicken Sie auf 2. tolino select Abo, um fortzufahren.
Bitte loggen Sie sich zunächst in Ihr Kundenkonto ein oder registrieren Sie sich bei bücher.de, um das eBook-Abo tolino select nutzen zu können.
Based on their own experiences of in-depth case studies of software projects in international corporations, in this book the authors present detailed practical guidelines on the preparation, conduct, design and reporting of case studies of software engineering. This is the first software engineering specific book on the case study research method.
- Geräte: PC
- eBook Hilfe
Andere Kunden interessierten sich auch für
Based on their own experiences of in-depth case studies of software projects in international corporations, in this book the authors present detailed practical guidelines on the preparation, conduct, design and reporting of case studies of software engineering. This is the first software engineering specific book on the case study research method.
Produktdetails
- Produktdetails
- Verlag: John Wiley & Sons
- Seitenzahl: 256
- Erscheinungstermin: 14. Februar 2012
- Englisch
- ISBN-13: 9781118181027
- Artikelnr.: 38238864
- Verlag: John Wiley & Sons
- Seitenzahl: 256
- Erscheinungstermin: 14. Februar 2012
- Englisch
- ISBN-13: 9781118181027
- Artikelnr.: 38238864
Dr. Austen Rainer is a Senior Lecturer in the School of Computer Science at the University of Hertfordshire. He is an active member of the Centre for Empirical Software Process Research (CESPR) and teaches several courses?in the BSc(Hons) and MSc degree programs. Dr. Per Runeson is leader of the Software Engineering Research Group at Lund University, as well as Research Director for EASE - Embedded Applications Software Engineering. He is a Senior Researcher at Sony Ericsson, where he fulfills his role as a verification advisor. His research focuses on efficient verification and validation processes. Dr. Martin Höst is Director of the M.Sc. Programme in Computer Science and Engineering at Lund University and a member of the Software Engineering Research Group (SERG). Dr. Björn Regnell is a professor of Software Engineering at Lund University's Department of Computer Science and Vice Dean of Research at the Faculty of Engineering, LTH. His research interests include market-driven software development, requirements engineering, software quality, software innovation, software product management, and empirical research methods.
Foreword xv Preface xix Acknowledgements xxi Part I. Case Study Methodology 1. Introduction 3 1.1 What is a case study? 3 1.2 A brief history of case studies in software engineering 5 1.3 Why a book on case studies of software engineering? 6 1.4 Conclusion 9 2. Background and definition of concepts 11 2.1 Introduction 11 2.2 Research strategies 12 2.3 Characteristics of research strategies 14 2.4 What makes a good case study? 18 2.5 When is the case study strategy feasible? 20 2.6 Case study research process 21 2.7 Conclusion 22 3. Design of the case study 23 3.1 Introduction 23 3.2 Elements of the case study design 24 3.3 Legal, ethical and professional issues 42 3.4 Conclusion 48 4. Data collection 49 4.1 Introduction 49 4.2 Different types of data sources 50 4.3 Interviews 52 4.4 Focus groups 57 4.5 Observations 58 4.6 Archival data 60 4.7 Metrics 61 4.8 Conclusion 63 5. Data analysis and interpretation 65 5.1 Introduction 65 5.2 Analysis of data in flexible research 66 5.3 Process for qualitative data analysis 70 5.4 Validity 75 5.5 Improving validity 77 5.6 Quantitative data analysis 79 5.7 Conclusion 81 6. Reporting and dissemination 83 6.1 Introduction 83 6.2 Why report and disseminate 84 6.3 The audience for the report 85 6.4 Aspects of the case study to report and disseminate 87 6.5 When to report and disseminate 88 6.6 Guidelines on reporting 88 6.7 Formats and structures for a report 99 6.8 Where to report 102 6.9 Ethics and confidentiality 102 6.10 Conclusion 104 7. Scaling up case study research 105 7.1 Introduction 105 7.2 The aims of scaling up case studies 106 7.3 Dimensions of scale 107 7.4 Longitudinal case studies 109 7.5 Multiple case studies 111 7.6 Multi-researcher case studies 114 7.7 Conclusion 116 8. Using case study research 117 8.1 Introduction 117 8.2 Reading and reviewing case studies 118 8.3 Identifying and synthesizing use case research 120 8.4 The economics of case study research 127 8.5 Specializing case study research for Software Engineering 130 8.6 Case studies and software process improvement 133 8.7 Conclusion 135 Part II. Examples of Case Studies 9. Introduction to case study examples 139 9.1 Introduction 139 10. Case studies of eXtreme Programming 143 10.1 Introduction 143 10.2 Case study design 144 10.3 Planning 146 10.4 Data collection 149 10.5 Data analysis 149 10.6 Reporting 156 10.7 Lessons learned 157 11. Longitudinal case studies of software project management 159 11.1 Introduction 159 11.2 Background to the research project 159 11.3 Case study design and planning 160 11.4 Data collection 164 11.5 Data analysis 166 11.6 Reporting 170 11.7 Lessons learned 172 12. An iterative case study of quality monitoring 173 12.1 Introduction 173 12.2 Case study design 175 12.3 Planning 176 12.4 Data analysis 179 12.5 Reporting 180 12.6 Lessons learned 180 13. An evaluative case study of software tools 181 13.1 Introduction 181 13.2 Design of the case study 182 13.3 Data collection 190 13.4 Data analysis 191 13.5 Reporting and dissemination 192 13.6 Lessons learned 193 14. A large-scale case study 195 14.1 Introduction 195 14.2 Case study design 196 14.3 Planning 201 14.4 Data collection 206 14.5 Data analysis 207 14.6 Lessons learned 208 Appendices 217 Appendix A. Checklists for reading and reviewing case studies 217 Appendix B. Example Interview instrument (XP) 221 Appendix C. Example interview instrument (REVV) 223 Appendix D. Example of a coding guide 227 Appendix E. Example of a consent information letter 233 Bibliography 235 References 235 Index 251
FOREWORD xiii PREFACE xv ACKNOWLEDGMENTS xvii PART I CASE STUDY METHODOLOGY
1 INTRODUCTION 3 1.1 What is a Case Study? 3 1.2 A Brief History of Case
Studies in Software Engineering 5 1.3 Why a Book on Case Studies of
Software Engineering? 6 1.4 Conclusion 9 2 BACKGROUND AND DEFINITION OF
CONCEPTS 11 2.1 Introduction 11 2.2 Research Strategies 11 2.3
Characteristics of Research Strategies 13 2.3.1 Purpose 13 2.3.2 Control
and Data 14 2.3.3 Triangulation 15 2.3.4 Replication 16 2.3.5 Inductive and
Deductive Enquiries 16 2.4 What Makes a Good Case Study? 17 2.5 When is the
Case Study Strategy Feasible? 19 2.6 Case Study Research Process 20 2.7
Conclusion 21 3 DESIGN OF THE CASE STUDY 23 3.1 Introduction 23 3.2
Elements of the Case Study Design 24 3.2.1 Rationale for the Study 24 3.2.2
Objective of the Study 24 3.2.3 Cases and Units of Analyses 26 3.2.4
Theoretical Framework 29 3.2.5 Research Questions 30 3.2.6 Propositions and
Hypotheses 31 3.2.7 Concepts 32 3.2.8 Methods of Data Collection 32 3.2.9
Methods of Data Analysis 33 3.2.10 Case Selection 33 3.2.11 Selection of
Data 35 3.2.12 Data Definition and Data Storage 36 3.2.13 Quality Control
and Assurance 36 3.2.14 Maintaining the Case Study Protocol 37 3.2.15
Reporting and Disseminating the Case Study 38 3.3 Legal, Ethical, and
Professional Issues 40 3.4 Conclusion 45 4 DATA COLLECTION 47 4.1
Introduction 47 4.2 Different Types of Data Source 47 4.2.1 Classification
of Data Sources 47 4.2.2 Data Source Selection 49 4.3 Interviews 50 4.3.1
Planning Interviews 50 4.3.2 The Interview Session 52 4.3.3 Postinterview
Activities 53 4.4 Focus groups 54 4.5 Observations 56 4.6 Archival Data 57
4.7 Metrics 58 4.8 Conclusion 60 5 DATA ANALYSIS AND INTERPRETATION 61 5.1
Introduction 61 5.2 Analysis of Data in Flexible Research 62 5.2.1
Introduction 62 5.2.2 Level of Formalism 64 5.2.3 Relation to Hypotheses 65
5.3 Process for Qualitative Data Analysis 65 5.3.1 Introduction 65 5.3.2
Steps in the Analysis 66 5.3.3 Techniques 68 5.3.4 Tool support 70 5.4
Validity 71 5.4.1 Construct Validity 71 5.4.2 Internal Validity 71 5.4.3
External Validity 71 5.4.4 Reliability 72 5.5 Improving Validity 72 5.6
Quantitative Data Analysis 74 5.7 Conclusion 76 6 REPORTING AND
DISSEMINATION 77 6.1 Introduction 77 6.2 Why Report and Disseminate 78 6.3
The Audience for the Report 79 6.4 Aspects of the Case Study to Report and
Disseminate 80 6.5 When to Report and Disseminate 81 6.6 Guidelines on
Reporting 82 6.6.1 The Generic Content of an Academic Report 82 6.6.2
Reporting Recommendations from Evaluative Case Studies 84 6.6.3 Reporting
to Stakeholders, Including Sponsor(s) 85 6.6.4 Reporting the Context of the
Case Study 87 6.6.5 Reporting to Students 89 6.6.6 Ad Hoc and Impromptu
Reporting 90 6.7 Formats and Structures for a Report 91 6.8 Where to Report
94 6.9 Ethics and Confidentiality 94 6.10 Conclusion 95 7 SCALING UP CASE
STUDY RESEARCH TO REAL-WORLD SOFTWARE PRACTICE 97 7.1 Introduction 97 7.2
The Aims of Scaling up Case Studies 98 7.3 Dimensions of Scale 99 7.4
Longitudinal Case Studies 100 7.5 Multiple Case Studies 102 7.5.1 Multiple
Cases and Replications 102 7.5.2 Selecting the Cases 104 7.6
Multiresearcher Case Studies 105 7.7 Conclusion 107 8 USING CASE STUDY
RESEARCH 109 8.1 Introduction 109 8.2 Reading and Reviewing Case Studies
109 8.2.1 Development of Checklists 110 8.2.2 Checklists for Conducting
Case Study Research 111 8.2.3 Checklists for Reading and Reviewing Case
Studies 111 8.2.4 Development of Practice 111 8.3 Identifying and
Synthesizing Use Case Research 111 8.3.1 Identifying Primary Studies 112
8.3.2 Synthesis of Evidence from Multiple Case Studies 113 8.3.3 Current
State of Synthesis 117 8.4 The Economics of Case Study Research 118 8.4.1
Costs and Benefits of Evaluation Techniques 119 8.4.2 Evaluation of the
DESMET Methodology 119 8.4.3 Frameworks for Organizing Methods of
Evaluation 119 8.5 Specializing Case Study Research for Software
Engineering 121 8.5.1 The Longitudinal Chronological Case Study Research
Strategy 122 8.5.2 Controlled Case Studies 123 8.6 Case Studies and
Software Process Improvement 123 8.7 Conclusion 125 PART II EXAMPLES OF
CASE STUDIES 9 INTRODUCTION TO CASE STUDY EXAMPLES 129 9.1 Introduction 129
10 CASE STUDY OF EXTREME PROGRAMMING IN A STAGE-GATE CONTEXT 133 10.1
Introduction 133 10.1.1 Methodological Status 133 10.2 Case Study Design
134 10.2.1 Rationale 134 10.2.2 Objectives 134 10.2.3 Cases and Units of
Analysis 135 10.2.4 Theoretical Frame of Reference 136 10.2.5 Research
Questions 136 10.3 Planning 136 10.3.1 Methods of Data Collection 136
10.3.2 Selection of Data 137 10.3.3 Case Selection Strategy 137 10.3.4 Case
Study Protocol 137 10.3.5 Ethical Considerations 137 10.4 Data Collection
139 10.5 Data Analysis 139 10.5.1 Threats to Validity 144 10.6 Reporting
144 10.6.1 Academics 144 10.6.2 Practitioners 144 10.7 Lessons Learned 146
11 TWO LONGITUDINAL CASE STUDIES OF SOFTWARE PROJECT MANAGEMENT 149 11.1
Introduction 149 11.2 Background to the Research Project 149 11.3 Case
Study Design and Planning 150 11.3.1 Rationale 150 11.3.2 Objective 150
11.3.3 Definition of the Case 150 11.3.4 Units of Analyses 151 11.3.5
Theoretical Frame of Reference and Research Questions 151 11.3.6 Case
Selection 151 11.3.7 Replication Strategy 152 11.3.8 Case Study Protocol
152 11.3.9 Quality Assurance, Validity, and Reliability 152 11.3.10 Legal,
Ethical, and Professional Considerations 153 11.4 Data Collection 154
11.4.1 Sources of Data 154 11.5 Data Analysis 157 11.6 Reporting 159 11.6.1
Internal Reporting of Results 160 11.6.2 Dissemination of Artifacts 160
11.7 Lessons Learned 160 12 AN ITERATIVE CASE STUDY OF QUALITY MONITORING
163 12.1 Introduction 163 12.2 Case Study Design 164 12.2.1 Objectives 164
12.2.2 Cases and Units of Analysis 165 12.2.3 Theoretical Frame of
Reference 165 12.2.4 Research Questions 165 12.3 Planning 165 12.3.1
Methods of Data Collection 165 12.3.2 Case Selection Strategy 167 12.3.3
Case Study Protocol 167 12.3.4 Ethical Considerations 167 12.3.5 Data
Collection 168 12.3.6 Exploratory Study 168 12.3.7 Confirmatory Study 168
12.3.8 Explanatory Study 168 12.4 Data Analysis 169 12.5 Reporting 169 12.6
Lessons Learned 169 13 A CASE STUDY OF THE EVALUATION OF REQUIREMENTS
MANAGEMENT TOOLS 171 13.1 Introduction 171 13.2 Design of the Case Study
172 13.2.1 Rationale 172 13.2.2 Objective 172 13.2.3 The Case and Its
Context 173 13.2.4 The Units of Analyses 174 13.2.5 Theoretical Framework
175 13.2.6 Research Questions 175 13.2.7 Propositions, Concepts, and
Measures 175 13.2.8 Case Study Protocol 175 13.2.9 Methods of Data
Collection 176 13.2.10 Methods of Data Analysis 176 13.2.11 Case Selection
Strategy 177 13.2.12 Data Selection Strategy 177 13.2.13 Replication
Strategy 177 13.2.14 Quality Assurance, Validity, and Reliability 177 13.3
Data Collection 178 13.4 Data Analysis 179 13.5 Reporting and Dissemination
180 13.6 Lessons Learned 181 14 A LARGE-SCALE CASE STUDY OF REQUIREMENTS
AND VERIFICATION ALIGNMENT 183 14.1 Introduction 183 14.2 Case Study Design
184 14.2.1 Rationale 184 14.2.2 Objectives 184 14.2.3 Cases and Units of
Analysis 185 14.2.4 Theoretical Frame of Reference 186 14.2.5 Research
Questions 187 14.3 Planning 188 14.3.1 Methods of Data Collection 189
14.3.2 Case Selection Strategy 190 14.3.3 Selection of Data 191 14.3.4 Case
Study Protocol 191 14.3.5 Ethical Considerations 192 14.4 Data Collection
192 14.5 Data Analysis 193 14.6 Lessons Learned 195 14.6.1 Effort
Estimation Lessons 195 14.6.2 Design and Planning Lessons 196 14.6.3 Data
Collection Lessons 197 14.6.4 Data Analysis Lessons 198 14.6.5 Reporting
Lessons 199 14.6.6 A General Lesson 199 EPILOGUE 201 Appendix A: CHECKLISTS
FOR READING AND REVIEWING CASE STUDIES 203 A.1 Design of the Case Study 203
A.2 Data Collection 204 A.3 Data Analysis and Interpretation 204 A.4
Reporting and Dissemination 204 A.5 Reader's Checklist 205 Appendix B:
EXAMPLE INTERVIEW INSTRUMENT (XP) 207 Appendix C: EXAMPLE INTERVIEW
INSTRUMENT (REVV) 209 Appendix D: EXAMPLE OF A CODING GUIDE 213 D.1 Coding
Instructions 213 D.2 Codes 214 D.2.1 High Level Codes: Research Questions
214 D.2.2 Medium Level Codes: Categories 216 D.2.3 Coding Example 216
Appendix E: EXAMPLE OF A CONSENT INFORMATION LETTER 219 REFERENCES 221
INDEX 235
1 INTRODUCTION 3 1.1 What is a Case Study? 3 1.2 A Brief History of Case
Studies in Software Engineering 5 1.3 Why a Book on Case Studies of
Software Engineering? 6 1.4 Conclusion 9 2 BACKGROUND AND DEFINITION OF
CONCEPTS 11 2.1 Introduction 11 2.2 Research Strategies 11 2.3
Characteristics of Research Strategies 13 2.3.1 Purpose 13 2.3.2 Control
and Data 14 2.3.3 Triangulation 15 2.3.4 Replication 16 2.3.5 Inductive and
Deductive Enquiries 16 2.4 What Makes a Good Case Study? 17 2.5 When is the
Case Study Strategy Feasible? 19 2.6 Case Study Research Process 20 2.7
Conclusion 21 3 DESIGN OF THE CASE STUDY 23 3.1 Introduction 23 3.2
Elements of the Case Study Design 24 3.2.1 Rationale for the Study 24 3.2.2
Objective of the Study 24 3.2.3 Cases and Units of Analyses 26 3.2.4
Theoretical Framework 29 3.2.5 Research Questions 30 3.2.6 Propositions and
Hypotheses 31 3.2.7 Concepts 32 3.2.8 Methods of Data Collection 32 3.2.9
Methods of Data Analysis 33 3.2.10 Case Selection 33 3.2.11 Selection of
Data 35 3.2.12 Data Definition and Data Storage 36 3.2.13 Quality Control
and Assurance 36 3.2.14 Maintaining the Case Study Protocol 37 3.2.15
Reporting and Disseminating the Case Study 38 3.3 Legal, Ethical, and
Professional Issues 40 3.4 Conclusion 45 4 DATA COLLECTION 47 4.1
Introduction 47 4.2 Different Types of Data Source 47 4.2.1 Classification
of Data Sources 47 4.2.2 Data Source Selection 49 4.3 Interviews 50 4.3.1
Planning Interviews 50 4.3.2 The Interview Session 52 4.3.3 Postinterview
Activities 53 4.4 Focus groups 54 4.5 Observations 56 4.6 Archival Data 57
4.7 Metrics 58 4.8 Conclusion 60 5 DATA ANALYSIS AND INTERPRETATION 61 5.1
Introduction 61 5.2 Analysis of Data in Flexible Research 62 5.2.1
Introduction 62 5.2.2 Level of Formalism 64 5.2.3 Relation to Hypotheses 65
5.3 Process for Qualitative Data Analysis 65 5.3.1 Introduction 65 5.3.2
Steps in the Analysis 66 5.3.3 Techniques 68 5.3.4 Tool support 70 5.4
Validity 71 5.4.1 Construct Validity 71 5.4.2 Internal Validity 71 5.4.3
External Validity 71 5.4.4 Reliability 72 5.5 Improving Validity 72 5.6
Quantitative Data Analysis 74 5.7 Conclusion 76 6 REPORTING AND
DISSEMINATION 77 6.1 Introduction 77 6.2 Why Report and Disseminate 78 6.3
The Audience for the Report 79 6.4 Aspects of the Case Study to Report and
Disseminate 80 6.5 When to Report and Disseminate 81 6.6 Guidelines on
Reporting 82 6.6.1 The Generic Content of an Academic Report 82 6.6.2
Reporting Recommendations from Evaluative Case Studies 84 6.6.3 Reporting
to Stakeholders, Including Sponsor(s) 85 6.6.4 Reporting the Context of the
Case Study 87 6.6.5 Reporting to Students 89 6.6.6 Ad Hoc and Impromptu
Reporting 90 6.7 Formats and Structures for a Report 91 6.8 Where to Report
94 6.9 Ethics and Confidentiality 94 6.10 Conclusion 95 7 SCALING UP CASE
STUDY RESEARCH TO REAL-WORLD SOFTWARE PRACTICE 97 7.1 Introduction 97 7.2
The Aims of Scaling up Case Studies 98 7.3 Dimensions of Scale 99 7.4
Longitudinal Case Studies 100 7.5 Multiple Case Studies 102 7.5.1 Multiple
Cases and Replications 102 7.5.2 Selecting the Cases 104 7.6
Multiresearcher Case Studies 105 7.7 Conclusion 107 8 USING CASE STUDY
RESEARCH 109 8.1 Introduction 109 8.2 Reading and Reviewing Case Studies
109 8.2.1 Development of Checklists 110 8.2.2 Checklists for Conducting
Case Study Research 111 8.2.3 Checklists for Reading and Reviewing Case
Studies 111 8.2.4 Development of Practice 111 8.3 Identifying and
Synthesizing Use Case Research 111 8.3.1 Identifying Primary Studies 112
8.3.2 Synthesis of Evidence from Multiple Case Studies 113 8.3.3 Current
State of Synthesis 117 8.4 The Economics of Case Study Research 118 8.4.1
Costs and Benefits of Evaluation Techniques 119 8.4.2 Evaluation of the
DESMET Methodology 119 8.4.3 Frameworks for Organizing Methods of
Evaluation 119 8.5 Specializing Case Study Research for Software
Engineering 121 8.5.1 The Longitudinal Chronological Case Study Research
Strategy 122 8.5.2 Controlled Case Studies 123 8.6 Case Studies and
Software Process Improvement 123 8.7 Conclusion 125 PART II EXAMPLES OF
CASE STUDIES 9 INTRODUCTION TO CASE STUDY EXAMPLES 129 9.1 Introduction 129
10 CASE STUDY OF EXTREME PROGRAMMING IN A STAGE-GATE CONTEXT 133 10.1
Introduction 133 10.1.1 Methodological Status 133 10.2 Case Study Design
134 10.2.1 Rationale 134 10.2.2 Objectives 134 10.2.3 Cases and Units of
Analysis 135 10.2.4 Theoretical Frame of Reference 136 10.2.5 Research
Questions 136 10.3 Planning 136 10.3.1 Methods of Data Collection 136
10.3.2 Selection of Data 137 10.3.3 Case Selection Strategy 137 10.3.4 Case
Study Protocol 137 10.3.5 Ethical Considerations 137 10.4 Data Collection
139 10.5 Data Analysis 139 10.5.1 Threats to Validity 144 10.6 Reporting
144 10.6.1 Academics 144 10.6.2 Practitioners 144 10.7 Lessons Learned 146
11 TWO LONGITUDINAL CASE STUDIES OF SOFTWARE PROJECT MANAGEMENT 149 11.1
Introduction 149 11.2 Background to the Research Project 149 11.3 Case
Study Design and Planning 150 11.3.1 Rationale 150 11.3.2 Objective 150
11.3.3 Definition of the Case 150 11.3.4 Units of Analyses 151 11.3.5
Theoretical Frame of Reference and Research Questions 151 11.3.6 Case
Selection 151 11.3.7 Replication Strategy 152 11.3.8 Case Study Protocol
152 11.3.9 Quality Assurance, Validity, and Reliability 152 11.3.10 Legal,
Ethical, and Professional Considerations 153 11.4 Data Collection 154
11.4.1 Sources of Data 154 11.5 Data Analysis 157 11.6 Reporting 159 11.6.1
Internal Reporting of Results 160 11.6.2 Dissemination of Artifacts 160
11.7 Lessons Learned 160 12 AN ITERATIVE CASE STUDY OF QUALITY MONITORING
163 12.1 Introduction 163 12.2 Case Study Design 164 12.2.1 Objectives 164
12.2.2 Cases and Units of Analysis 165 12.2.3 Theoretical Frame of
Reference 165 12.2.4 Research Questions 165 12.3 Planning 165 12.3.1
Methods of Data Collection 165 12.3.2 Case Selection Strategy 167 12.3.3
Case Study Protocol 167 12.3.4 Ethical Considerations 167 12.3.5 Data
Collection 168 12.3.6 Exploratory Study 168 12.3.7 Confirmatory Study 168
12.3.8 Explanatory Study 168 12.4 Data Analysis 169 12.5 Reporting 169 12.6
Lessons Learned 169 13 A CASE STUDY OF THE EVALUATION OF REQUIREMENTS
MANAGEMENT TOOLS 171 13.1 Introduction 171 13.2 Design of the Case Study
172 13.2.1 Rationale 172 13.2.2 Objective 172 13.2.3 The Case and Its
Context 173 13.2.4 The Units of Analyses 174 13.2.5 Theoretical Framework
175 13.2.6 Research Questions 175 13.2.7 Propositions, Concepts, and
Measures 175 13.2.8 Case Study Protocol 175 13.2.9 Methods of Data
Collection 176 13.2.10 Methods of Data Analysis 176 13.2.11 Case Selection
Strategy 177 13.2.12 Data Selection Strategy 177 13.2.13 Replication
Strategy 177 13.2.14 Quality Assurance, Validity, and Reliability 177 13.3
Data Collection 178 13.4 Data Analysis 179 13.5 Reporting and Dissemination
180 13.6 Lessons Learned 181 14 A LARGE-SCALE CASE STUDY OF REQUIREMENTS
AND VERIFICATION ALIGNMENT 183 14.1 Introduction 183 14.2 Case Study Design
184 14.2.1 Rationale 184 14.2.2 Objectives 184 14.2.3 Cases and Units of
Analysis 185 14.2.4 Theoretical Frame of Reference 186 14.2.5 Research
Questions 187 14.3 Planning 188 14.3.1 Methods of Data Collection 189
14.3.2 Case Selection Strategy 190 14.3.3 Selection of Data 191 14.3.4 Case
Study Protocol 191 14.3.5 Ethical Considerations 192 14.4 Data Collection
192 14.5 Data Analysis 193 14.6 Lessons Learned 195 14.6.1 Effort
Estimation Lessons 195 14.6.2 Design and Planning Lessons 196 14.6.3 Data
Collection Lessons 197 14.6.4 Data Analysis Lessons 198 14.6.5 Reporting
Lessons 199 14.6.6 A General Lesson 199 EPILOGUE 201 Appendix A: CHECKLISTS
FOR READING AND REVIEWING CASE STUDIES 203 A.1 Design of the Case Study 203
A.2 Data Collection 204 A.3 Data Analysis and Interpretation 204 A.4
Reporting and Dissemination 204 A.5 Reader's Checklist 205 Appendix B:
EXAMPLE INTERVIEW INSTRUMENT (XP) 207 Appendix C: EXAMPLE INTERVIEW
INSTRUMENT (REVV) 209 Appendix D: EXAMPLE OF A CODING GUIDE 213 D.1 Coding
Instructions 213 D.2 Codes 214 D.2.1 High Level Codes: Research Questions
214 D.2.2 Medium Level Codes: Categories 216 D.2.3 Coding Example 216
Appendix E: EXAMPLE OF A CONSENT INFORMATION LETTER 219 REFERENCES 221
INDEX 235
Foreword xv Preface xix Acknowledgements xxi Part I. Case Study Methodology 1. Introduction 3 1.1 What is a case study? 3 1.2 A brief history of case studies in software engineering 5 1.3 Why a book on case studies of software engineering? 6 1.4 Conclusion 9 2. Background and definition of concepts 11 2.1 Introduction 11 2.2 Research strategies 12 2.3 Characteristics of research strategies 14 2.4 What makes a good case study? 18 2.5 When is the case study strategy feasible? 20 2.6 Case study research process 21 2.7 Conclusion 22 3. Design of the case study 23 3.1 Introduction 23 3.2 Elements of the case study design 24 3.3 Legal, ethical and professional issues 42 3.4 Conclusion 48 4. Data collection 49 4.1 Introduction 49 4.2 Different types of data sources 50 4.3 Interviews 52 4.4 Focus groups 57 4.5 Observations 58 4.6 Archival data 60 4.7 Metrics 61 4.8 Conclusion 63 5. Data analysis and interpretation 65 5.1 Introduction 65 5.2 Analysis of data in flexible research 66 5.3 Process for qualitative data analysis 70 5.4 Validity 75 5.5 Improving validity 77 5.6 Quantitative data analysis 79 5.7 Conclusion 81 6. Reporting and dissemination 83 6.1 Introduction 83 6.2 Why report and disseminate 84 6.3 The audience for the report 85 6.4 Aspects of the case study to report and disseminate 87 6.5 When to report and disseminate 88 6.6 Guidelines on reporting 88 6.7 Formats and structures for a report 99 6.8 Where to report 102 6.9 Ethics and confidentiality 102 6.10 Conclusion 104 7. Scaling up case study research 105 7.1 Introduction 105 7.2 The aims of scaling up case studies 106 7.3 Dimensions of scale 107 7.4 Longitudinal case studies 109 7.5 Multiple case studies 111 7.6 Multi-researcher case studies 114 7.7 Conclusion 116 8. Using case study research 117 8.1 Introduction 117 8.2 Reading and reviewing case studies 118 8.3 Identifying and synthesizing use case research 120 8.4 The economics of case study research 127 8.5 Specializing case study research for Software Engineering 130 8.6 Case studies and software process improvement 133 8.7 Conclusion 135 Part II. Examples of Case Studies 9. Introduction to case study examples 139 9.1 Introduction 139 10. Case studies of eXtreme Programming 143 10.1 Introduction 143 10.2 Case study design 144 10.3 Planning 146 10.4 Data collection 149 10.5 Data analysis 149 10.6 Reporting 156 10.7 Lessons learned 157 11. Longitudinal case studies of software project management 159 11.1 Introduction 159 11.2 Background to the research project 159 11.3 Case study design and planning 160 11.4 Data collection 164 11.5 Data analysis 166 11.6 Reporting 170 11.7 Lessons learned 172 12. An iterative case study of quality monitoring 173 12.1 Introduction 173 12.2 Case study design 175 12.3 Planning 176 12.4 Data analysis 179 12.5 Reporting 180 12.6 Lessons learned 180 13. An evaluative case study of software tools 181 13.1 Introduction 181 13.2 Design of the case study 182 13.3 Data collection 190 13.4 Data analysis 191 13.5 Reporting and dissemination 192 13.6 Lessons learned 193 14. A large-scale case study 195 14.1 Introduction 195 14.2 Case study design 196 14.3 Planning 201 14.4 Data collection 206 14.5 Data analysis 207 14.6 Lessons learned 208 Appendices 217 Appendix A. Checklists for reading and reviewing case studies 217 Appendix B. Example Interview instrument (XP) 221 Appendix C. Example interview instrument (REVV) 223 Appendix D. Example of a coding guide 227 Appendix E. Example of a consent information letter 233 Bibliography 235 References 235 Index 251
FOREWORD xiii PREFACE xv ACKNOWLEDGMENTS xvii PART I CASE STUDY METHODOLOGY
1 INTRODUCTION 3 1.1 What is a Case Study? 3 1.2 A Brief History of Case
Studies in Software Engineering 5 1.3 Why a Book on Case Studies of
Software Engineering? 6 1.4 Conclusion 9 2 BACKGROUND AND DEFINITION OF
CONCEPTS 11 2.1 Introduction 11 2.2 Research Strategies 11 2.3
Characteristics of Research Strategies 13 2.3.1 Purpose 13 2.3.2 Control
and Data 14 2.3.3 Triangulation 15 2.3.4 Replication 16 2.3.5 Inductive and
Deductive Enquiries 16 2.4 What Makes a Good Case Study? 17 2.5 When is the
Case Study Strategy Feasible? 19 2.6 Case Study Research Process 20 2.7
Conclusion 21 3 DESIGN OF THE CASE STUDY 23 3.1 Introduction 23 3.2
Elements of the Case Study Design 24 3.2.1 Rationale for the Study 24 3.2.2
Objective of the Study 24 3.2.3 Cases and Units of Analyses 26 3.2.4
Theoretical Framework 29 3.2.5 Research Questions 30 3.2.6 Propositions and
Hypotheses 31 3.2.7 Concepts 32 3.2.8 Methods of Data Collection 32 3.2.9
Methods of Data Analysis 33 3.2.10 Case Selection 33 3.2.11 Selection of
Data 35 3.2.12 Data Definition and Data Storage 36 3.2.13 Quality Control
and Assurance 36 3.2.14 Maintaining the Case Study Protocol 37 3.2.15
Reporting and Disseminating the Case Study 38 3.3 Legal, Ethical, and
Professional Issues 40 3.4 Conclusion 45 4 DATA COLLECTION 47 4.1
Introduction 47 4.2 Different Types of Data Source 47 4.2.1 Classification
of Data Sources 47 4.2.2 Data Source Selection 49 4.3 Interviews 50 4.3.1
Planning Interviews 50 4.3.2 The Interview Session 52 4.3.3 Postinterview
Activities 53 4.4 Focus groups 54 4.5 Observations 56 4.6 Archival Data 57
4.7 Metrics 58 4.8 Conclusion 60 5 DATA ANALYSIS AND INTERPRETATION 61 5.1
Introduction 61 5.2 Analysis of Data in Flexible Research 62 5.2.1
Introduction 62 5.2.2 Level of Formalism 64 5.2.3 Relation to Hypotheses 65
5.3 Process for Qualitative Data Analysis 65 5.3.1 Introduction 65 5.3.2
Steps in the Analysis 66 5.3.3 Techniques 68 5.3.4 Tool support 70 5.4
Validity 71 5.4.1 Construct Validity 71 5.4.2 Internal Validity 71 5.4.3
External Validity 71 5.4.4 Reliability 72 5.5 Improving Validity 72 5.6
Quantitative Data Analysis 74 5.7 Conclusion 76 6 REPORTING AND
DISSEMINATION 77 6.1 Introduction 77 6.2 Why Report and Disseminate 78 6.3
The Audience for the Report 79 6.4 Aspects of the Case Study to Report and
Disseminate 80 6.5 When to Report and Disseminate 81 6.6 Guidelines on
Reporting 82 6.6.1 The Generic Content of an Academic Report 82 6.6.2
Reporting Recommendations from Evaluative Case Studies 84 6.6.3 Reporting
to Stakeholders, Including Sponsor(s) 85 6.6.4 Reporting the Context of the
Case Study 87 6.6.5 Reporting to Students 89 6.6.6 Ad Hoc and Impromptu
Reporting 90 6.7 Formats and Structures for a Report 91 6.8 Where to Report
94 6.9 Ethics and Confidentiality 94 6.10 Conclusion 95 7 SCALING UP CASE
STUDY RESEARCH TO REAL-WORLD SOFTWARE PRACTICE 97 7.1 Introduction 97 7.2
The Aims of Scaling up Case Studies 98 7.3 Dimensions of Scale 99 7.4
Longitudinal Case Studies 100 7.5 Multiple Case Studies 102 7.5.1 Multiple
Cases and Replications 102 7.5.2 Selecting the Cases 104 7.6
Multiresearcher Case Studies 105 7.7 Conclusion 107 8 USING CASE STUDY
RESEARCH 109 8.1 Introduction 109 8.2 Reading and Reviewing Case Studies
109 8.2.1 Development of Checklists 110 8.2.2 Checklists for Conducting
Case Study Research 111 8.2.3 Checklists for Reading and Reviewing Case
Studies 111 8.2.4 Development of Practice 111 8.3 Identifying and
Synthesizing Use Case Research 111 8.3.1 Identifying Primary Studies 112
8.3.2 Synthesis of Evidence from Multiple Case Studies 113 8.3.3 Current
State of Synthesis 117 8.4 The Economics of Case Study Research 118 8.4.1
Costs and Benefits of Evaluation Techniques 119 8.4.2 Evaluation of the
DESMET Methodology 119 8.4.3 Frameworks for Organizing Methods of
Evaluation 119 8.5 Specializing Case Study Research for Software
Engineering 121 8.5.1 The Longitudinal Chronological Case Study Research
Strategy 122 8.5.2 Controlled Case Studies 123 8.6 Case Studies and
Software Process Improvement 123 8.7 Conclusion 125 PART II EXAMPLES OF
CASE STUDIES 9 INTRODUCTION TO CASE STUDY EXAMPLES 129 9.1 Introduction 129
10 CASE STUDY OF EXTREME PROGRAMMING IN A STAGE-GATE CONTEXT 133 10.1
Introduction 133 10.1.1 Methodological Status 133 10.2 Case Study Design
134 10.2.1 Rationale 134 10.2.2 Objectives 134 10.2.3 Cases and Units of
Analysis 135 10.2.4 Theoretical Frame of Reference 136 10.2.5 Research
Questions 136 10.3 Planning 136 10.3.1 Methods of Data Collection 136
10.3.2 Selection of Data 137 10.3.3 Case Selection Strategy 137 10.3.4 Case
Study Protocol 137 10.3.5 Ethical Considerations 137 10.4 Data Collection
139 10.5 Data Analysis 139 10.5.1 Threats to Validity 144 10.6 Reporting
144 10.6.1 Academics 144 10.6.2 Practitioners 144 10.7 Lessons Learned 146
11 TWO LONGITUDINAL CASE STUDIES OF SOFTWARE PROJECT MANAGEMENT 149 11.1
Introduction 149 11.2 Background to the Research Project 149 11.3 Case
Study Design and Planning 150 11.3.1 Rationale 150 11.3.2 Objective 150
11.3.3 Definition of the Case 150 11.3.4 Units of Analyses 151 11.3.5
Theoretical Frame of Reference and Research Questions 151 11.3.6 Case
Selection 151 11.3.7 Replication Strategy 152 11.3.8 Case Study Protocol
152 11.3.9 Quality Assurance, Validity, and Reliability 152 11.3.10 Legal,
Ethical, and Professional Considerations 153 11.4 Data Collection 154
11.4.1 Sources of Data 154 11.5 Data Analysis 157 11.6 Reporting 159 11.6.1
Internal Reporting of Results 160 11.6.2 Dissemination of Artifacts 160
11.7 Lessons Learned 160 12 AN ITERATIVE CASE STUDY OF QUALITY MONITORING
163 12.1 Introduction 163 12.2 Case Study Design 164 12.2.1 Objectives 164
12.2.2 Cases and Units of Analysis 165 12.2.3 Theoretical Frame of
Reference 165 12.2.4 Research Questions 165 12.3 Planning 165 12.3.1
Methods of Data Collection 165 12.3.2 Case Selection Strategy 167 12.3.3
Case Study Protocol 167 12.3.4 Ethical Considerations 167 12.3.5 Data
Collection 168 12.3.6 Exploratory Study 168 12.3.7 Confirmatory Study 168
12.3.8 Explanatory Study 168 12.4 Data Analysis 169 12.5 Reporting 169 12.6
Lessons Learned 169 13 A CASE STUDY OF THE EVALUATION OF REQUIREMENTS
MANAGEMENT TOOLS 171 13.1 Introduction 171 13.2 Design of the Case Study
172 13.2.1 Rationale 172 13.2.2 Objective 172 13.2.3 The Case and Its
Context 173 13.2.4 The Units of Analyses 174 13.2.5 Theoretical Framework
175 13.2.6 Research Questions 175 13.2.7 Propositions, Concepts, and
Measures 175 13.2.8 Case Study Protocol 175 13.2.9 Methods of Data
Collection 176 13.2.10 Methods of Data Analysis 176 13.2.11 Case Selection
Strategy 177 13.2.12 Data Selection Strategy 177 13.2.13 Replication
Strategy 177 13.2.14 Quality Assurance, Validity, and Reliability 177 13.3
Data Collection 178 13.4 Data Analysis 179 13.5 Reporting and Dissemination
180 13.6 Lessons Learned 181 14 A LARGE-SCALE CASE STUDY OF REQUIREMENTS
AND VERIFICATION ALIGNMENT 183 14.1 Introduction 183 14.2 Case Study Design
184 14.2.1 Rationale 184 14.2.2 Objectives 184 14.2.3 Cases and Units of
Analysis 185 14.2.4 Theoretical Frame of Reference 186 14.2.5 Research
Questions 187 14.3 Planning 188 14.3.1 Methods of Data Collection 189
14.3.2 Case Selection Strategy 190 14.3.3 Selection of Data 191 14.3.4 Case
Study Protocol 191 14.3.5 Ethical Considerations 192 14.4 Data Collection
192 14.5 Data Analysis 193 14.6 Lessons Learned 195 14.6.1 Effort
Estimation Lessons 195 14.6.2 Design and Planning Lessons 196 14.6.3 Data
Collection Lessons 197 14.6.4 Data Analysis Lessons 198 14.6.5 Reporting
Lessons 199 14.6.6 A General Lesson 199 EPILOGUE 201 Appendix A: CHECKLISTS
FOR READING AND REVIEWING CASE STUDIES 203 A.1 Design of the Case Study 203
A.2 Data Collection 204 A.3 Data Analysis and Interpretation 204 A.4
Reporting and Dissemination 204 A.5 Reader's Checklist 205 Appendix B:
EXAMPLE INTERVIEW INSTRUMENT (XP) 207 Appendix C: EXAMPLE INTERVIEW
INSTRUMENT (REVV) 209 Appendix D: EXAMPLE OF A CODING GUIDE 213 D.1 Coding
Instructions 213 D.2 Codes 214 D.2.1 High Level Codes: Research Questions
214 D.2.2 Medium Level Codes: Categories 216 D.2.3 Coding Example 216
Appendix E: EXAMPLE OF A CONSENT INFORMATION LETTER 219 REFERENCES 221
INDEX 235
1 INTRODUCTION 3 1.1 What is a Case Study? 3 1.2 A Brief History of Case
Studies in Software Engineering 5 1.3 Why a Book on Case Studies of
Software Engineering? 6 1.4 Conclusion 9 2 BACKGROUND AND DEFINITION OF
CONCEPTS 11 2.1 Introduction 11 2.2 Research Strategies 11 2.3
Characteristics of Research Strategies 13 2.3.1 Purpose 13 2.3.2 Control
and Data 14 2.3.3 Triangulation 15 2.3.4 Replication 16 2.3.5 Inductive and
Deductive Enquiries 16 2.4 What Makes a Good Case Study? 17 2.5 When is the
Case Study Strategy Feasible? 19 2.6 Case Study Research Process 20 2.7
Conclusion 21 3 DESIGN OF THE CASE STUDY 23 3.1 Introduction 23 3.2
Elements of the Case Study Design 24 3.2.1 Rationale for the Study 24 3.2.2
Objective of the Study 24 3.2.3 Cases and Units of Analyses 26 3.2.4
Theoretical Framework 29 3.2.5 Research Questions 30 3.2.6 Propositions and
Hypotheses 31 3.2.7 Concepts 32 3.2.8 Methods of Data Collection 32 3.2.9
Methods of Data Analysis 33 3.2.10 Case Selection 33 3.2.11 Selection of
Data 35 3.2.12 Data Definition and Data Storage 36 3.2.13 Quality Control
and Assurance 36 3.2.14 Maintaining the Case Study Protocol 37 3.2.15
Reporting and Disseminating the Case Study 38 3.3 Legal, Ethical, and
Professional Issues 40 3.4 Conclusion 45 4 DATA COLLECTION 47 4.1
Introduction 47 4.2 Different Types of Data Source 47 4.2.1 Classification
of Data Sources 47 4.2.2 Data Source Selection 49 4.3 Interviews 50 4.3.1
Planning Interviews 50 4.3.2 The Interview Session 52 4.3.3 Postinterview
Activities 53 4.4 Focus groups 54 4.5 Observations 56 4.6 Archival Data 57
4.7 Metrics 58 4.8 Conclusion 60 5 DATA ANALYSIS AND INTERPRETATION 61 5.1
Introduction 61 5.2 Analysis of Data in Flexible Research 62 5.2.1
Introduction 62 5.2.2 Level of Formalism 64 5.2.3 Relation to Hypotheses 65
5.3 Process for Qualitative Data Analysis 65 5.3.1 Introduction 65 5.3.2
Steps in the Analysis 66 5.3.3 Techniques 68 5.3.4 Tool support 70 5.4
Validity 71 5.4.1 Construct Validity 71 5.4.2 Internal Validity 71 5.4.3
External Validity 71 5.4.4 Reliability 72 5.5 Improving Validity 72 5.6
Quantitative Data Analysis 74 5.7 Conclusion 76 6 REPORTING AND
DISSEMINATION 77 6.1 Introduction 77 6.2 Why Report and Disseminate 78 6.3
The Audience for the Report 79 6.4 Aspects of the Case Study to Report and
Disseminate 80 6.5 When to Report and Disseminate 81 6.6 Guidelines on
Reporting 82 6.6.1 The Generic Content of an Academic Report 82 6.6.2
Reporting Recommendations from Evaluative Case Studies 84 6.6.3 Reporting
to Stakeholders, Including Sponsor(s) 85 6.6.4 Reporting the Context of the
Case Study 87 6.6.5 Reporting to Students 89 6.6.6 Ad Hoc and Impromptu
Reporting 90 6.7 Formats and Structures for a Report 91 6.8 Where to Report
94 6.9 Ethics and Confidentiality 94 6.10 Conclusion 95 7 SCALING UP CASE
STUDY RESEARCH TO REAL-WORLD SOFTWARE PRACTICE 97 7.1 Introduction 97 7.2
The Aims of Scaling up Case Studies 98 7.3 Dimensions of Scale 99 7.4
Longitudinal Case Studies 100 7.5 Multiple Case Studies 102 7.5.1 Multiple
Cases and Replications 102 7.5.2 Selecting the Cases 104 7.6
Multiresearcher Case Studies 105 7.7 Conclusion 107 8 USING CASE STUDY
RESEARCH 109 8.1 Introduction 109 8.2 Reading and Reviewing Case Studies
109 8.2.1 Development of Checklists 110 8.2.2 Checklists for Conducting
Case Study Research 111 8.2.3 Checklists for Reading and Reviewing Case
Studies 111 8.2.4 Development of Practice 111 8.3 Identifying and
Synthesizing Use Case Research 111 8.3.1 Identifying Primary Studies 112
8.3.2 Synthesis of Evidence from Multiple Case Studies 113 8.3.3 Current
State of Synthesis 117 8.4 The Economics of Case Study Research 118 8.4.1
Costs and Benefits of Evaluation Techniques 119 8.4.2 Evaluation of the
DESMET Methodology 119 8.4.3 Frameworks for Organizing Methods of
Evaluation 119 8.5 Specializing Case Study Research for Software
Engineering 121 8.5.1 The Longitudinal Chronological Case Study Research
Strategy 122 8.5.2 Controlled Case Studies 123 8.6 Case Studies and
Software Process Improvement 123 8.7 Conclusion 125 PART II EXAMPLES OF
CASE STUDIES 9 INTRODUCTION TO CASE STUDY EXAMPLES 129 9.1 Introduction 129
10 CASE STUDY OF EXTREME PROGRAMMING IN A STAGE-GATE CONTEXT 133 10.1
Introduction 133 10.1.1 Methodological Status 133 10.2 Case Study Design
134 10.2.1 Rationale 134 10.2.2 Objectives 134 10.2.3 Cases and Units of
Analysis 135 10.2.4 Theoretical Frame of Reference 136 10.2.5 Research
Questions 136 10.3 Planning 136 10.3.1 Methods of Data Collection 136
10.3.2 Selection of Data 137 10.3.3 Case Selection Strategy 137 10.3.4 Case
Study Protocol 137 10.3.5 Ethical Considerations 137 10.4 Data Collection
139 10.5 Data Analysis 139 10.5.1 Threats to Validity 144 10.6 Reporting
144 10.6.1 Academics 144 10.6.2 Practitioners 144 10.7 Lessons Learned 146
11 TWO LONGITUDINAL CASE STUDIES OF SOFTWARE PROJECT MANAGEMENT 149 11.1
Introduction 149 11.2 Background to the Research Project 149 11.3 Case
Study Design and Planning 150 11.3.1 Rationale 150 11.3.2 Objective 150
11.3.3 Definition of the Case 150 11.3.4 Units of Analyses 151 11.3.5
Theoretical Frame of Reference and Research Questions 151 11.3.6 Case
Selection 151 11.3.7 Replication Strategy 152 11.3.8 Case Study Protocol
152 11.3.9 Quality Assurance, Validity, and Reliability 152 11.3.10 Legal,
Ethical, and Professional Considerations 153 11.4 Data Collection 154
11.4.1 Sources of Data 154 11.5 Data Analysis 157 11.6 Reporting 159 11.6.1
Internal Reporting of Results 160 11.6.2 Dissemination of Artifacts 160
11.7 Lessons Learned 160 12 AN ITERATIVE CASE STUDY OF QUALITY MONITORING
163 12.1 Introduction 163 12.2 Case Study Design 164 12.2.1 Objectives 164
12.2.2 Cases and Units of Analysis 165 12.2.3 Theoretical Frame of
Reference 165 12.2.4 Research Questions 165 12.3 Planning 165 12.3.1
Methods of Data Collection 165 12.3.2 Case Selection Strategy 167 12.3.3
Case Study Protocol 167 12.3.4 Ethical Considerations 167 12.3.5 Data
Collection 168 12.3.6 Exploratory Study 168 12.3.7 Confirmatory Study 168
12.3.8 Explanatory Study 168 12.4 Data Analysis 169 12.5 Reporting 169 12.6
Lessons Learned 169 13 A CASE STUDY OF THE EVALUATION OF REQUIREMENTS
MANAGEMENT TOOLS 171 13.1 Introduction 171 13.2 Design of the Case Study
172 13.2.1 Rationale 172 13.2.2 Objective 172 13.2.3 The Case and Its
Context 173 13.2.4 The Units of Analyses 174 13.2.5 Theoretical Framework
175 13.2.6 Research Questions 175 13.2.7 Propositions, Concepts, and
Measures 175 13.2.8 Case Study Protocol 175 13.2.9 Methods of Data
Collection 176 13.2.10 Methods of Data Analysis 176 13.2.11 Case Selection
Strategy 177 13.2.12 Data Selection Strategy 177 13.2.13 Replication
Strategy 177 13.2.14 Quality Assurance, Validity, and Reliability 177 13.3
Data Collection 178 13.4 Data Analysis 179 13.5 Reporting and Dissemination
180 13.6 Lessons Learned 181 14 A LARGE-SCALE CASE STUDY OF REQUIREMENTS
AND VERIFICATION ALIGNMENT 183 14.1 Introduction 183 14.2 Case Study Design
184 14.2.1 Rationale 184 14.2.2 Objectives 184 14.2.3 Cases and Units of
Analysis 185 14.2.4 Theoretical Frame of Reference 186 14.2.5 Research
Questions 187 14.3 Planning 188 14.3.1 Methods of Data Collection 189
14.3.2 Case Selection Strategy 190 14.3.3 Selection of Data 191 14.3.4 Case
Study Protocol 191 14.3.5 Ethical Considerations 192 14.4 Data Collection
192 14.5 Data Analysis 193 14.6 Lessons Learned 195 14.6.1 Effort
Estimation Lessons 195 14.6.2 Design and Planning Lessons 196 14.6.3 Data
Collection Lessons 197 14.6.4 Data Analysis Lessons 198 14.6.5 Reporting
Lessons 199 14.6.6 A General Lesson 199 EPILOGUE 201 Appendix A: CHECKLISTS
FOR READING AND REVIEWING CASE STUDIES 203 A.1 Design of the Case Study 203
A.2 Data Collection 204 A.3 Data Analysis and Interpretation 204 A.4
Reporting and Dissemination 204 A.5 Reader's Checklist 205 Appendix B:
EXAMPLE INTERVIEW INSTRUMENT (XP) 207 Appendix C: EXAMPLE INTERVIEW
INSTRUMENT (REVV) 209 Appendix D: EXAMPLE OF A CODING GUIDE 213 D.1 Coding
Instructions 213 D.2 Codes 214 D.2.1 High Level Codes: Research Questions
214 D.2.2 Medium Level Codes: Categories 216 D.2.3 Coding Example 216
Appendix E: EXAMPLE OF A CONSENT INFORMATION LETTER 219 REFERENCES 221
INDEX 235