Skip to main content
  • Textbook
  • © 2012

Experimentation in Software Engineering

  • The premiere book on how to systematically conduct and evaluate experiments in software engineering
  • The authors are an experienced team of researchers and practitioners with more than eighty years of combined experience with empirical studies
  • Self-contained presentation of experimentation and its process steps, and enriched by chapters on case studies and systematic literature reviews
  • Includes supplementary material: sn.pub/extras

Buy it now

Buying options

eBook USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 89.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (13 chapters)

  1. Front Matter

    Pages i-xxiii
  2. Background

    1. Front Matter

      Pages 1-1
    2. Introduction

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 3-8
    3. Empirical Strategies

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 9-36
    4. Measurement

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 37-43
    5. Systematic Literature Reviews

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 45-54
    6. Case Studies

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 55-72
    7. Experiment Process

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 73-81
  3. Steps in the Experiment Process

    1. Front Matter

      Pages 83-83
    2. Scoping

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 85-88
    3. Planning

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 89-116
    4. Operation

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 117-122
    5. Analysis and Interpretation

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 123-151
    6. Presentation and Package

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 153-157
  4. Example Experiments

    1. Front Matter

      Pages 159-159
    2. Experiment Process Illustration

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 161-174
    3. Are the Perspectives Really Different?: Further Experimentation on Scenario-Based Reading of Requirements

      • Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén
      Pages 175-200
  5. Back Matter

    Pages 201-236

About this book

Like other sciences and engineering disciplines, software engineering requires a cycle of model building, experimentation, and learning. Experiments are valuable tools for all software engineers who are involved in evaluating and choosing between different methods, techniques, languages and tools.

The purpose of Experimentation in Software Engineering is to introduce students, teachers, researchers, and practitioners to empirical studies in software engineering, using controlled experiments. The introduction to experimentation is provided through a process perspective, and the focus is on the steps that we have to go through to perform an experiment. The book is divided into three parts. The first part provides a background of theories and methods used in experimentation. Part II then devotes one chapter to each of the five experiment steps: scoping, planning, execution, analysis, and result presentation. Part III completes the presentation with two examples. Assignments and statistical material are provided in appendixes. Overall the book provides indispensable information regarding empirical studies in particular for experiments, but also for case studies, systematic literature reviews, and surveys. It is a revision of the authors’ book, which was published in 2000. In addition, substantial new material, e.g. concerning systematic literature reviews and case study research, is introduced. 

The book is self-contained and it is suitable as a course book in undergraduate or graduate studies where the need for empirical studies in software engineering is stressed. Exercises and assignments are included to combine the more theoretical material with practical aspects. Researchers will also benefit from the book, learning more about how to conduct empirical studies, and likewise practitioners may use it as a “cookbook” when evaluating new methods or techniques before implementing them in their organization.

Reviews

From the reviews:

"The revised edition includes new chapters and examples, which further cements its place as the premier book on the topics of designing, constructing, executing, and assessing experiments in software engineering. (...) The revisions will make this book even more valuable. (...) It ought to be required reading for all PhD students; every academic’s bookcase should have a copy." (Michael Oudshoorn, Computing Reviews, October, 2012)

“This book is a landmark in allowing us to train both the researcher and practitioner in software engineering experimentation.” (Victor R. Basili, University of Maryland, MD, USA)

“The additions and modifications in this revised version very nicely reflect the maturation of the field of empirical software engineering.” (Anneliese A. Andrews, University of Denver , CO, USA)

“The volume, a revised edition of a work by the same name … published in 2000, presents a very useful review of methods in software engineering research. It is structured as a textbook, making it useful for an introductory graduate-level course or a fourth-year course at the undergraduate level. Practitioners and experts will also benefit from this book, as they can use it as a starting point for more in-depth approaches. … Summing Up: Highly recommended. Upper-division undergraduates through professionals/practitioners.” (L. Benedicenti, Choice, Vol. 50 (9), May, 2013)

Authors and Affiliations

  • , School of Computing (COM), Blekinge Institute of Technology, Karlskrona, Sweden

    Claes Wohlin

  • , Department of Computer Science, Lund University, Lund, Sweden

    Per Runeson, Martin Höst

  • System Verification Sweden AB, Malmö, Sweden

    Magnus C. Ohlsson

  • Department of Computer Science, Lund University, Lund, Sweden

    Björn Regnell

  • ST-Ericsson AB, Lund, Sweden

    Anders Wesslén

About the authors

CLAES WOHLIN is a professor of software engineering at Blekinge Institute of Technology. His research interests include empirical methods in software engineering, software processes and software quality. He is a member of the Royal Swedish Academy of Engineering Sciences and a senior member of the IEEE.

PER RUNESON is a professor of software engineering at Lund University. His research interests include empirical research on software testing and quality, and methods for such research. Prior to this, he worked as a consulting expert in industry, and he is a senior member of the IEEE.

MARTIN HÖST is a professor of software engineering at Lund University. His research interests include software quality and software process improvement, as well as empirical research methods in software engineering.

MAGNUS C. OHLSSON is a quality assurance specialist at System Verification AB in Malmö, focusing on process improvement. His primary field of interest is verification andvalidation, with an emphasis on achieving proper quality efficiently throughout every step of the development process.

BJÖRN REGNELL is a professor of software engineering at Lund University. His research interests include software requirement engineering, software product management, and empirical research on software engineering.

ANDERS WESSLÉN is a senior system architect at ST-Ericsson in Lund. His focus is on system-wide architectures, as well as system design and requirements.

Bibliographic Information

  • Book Title: Experimentation in Software Engineering

  • Authors: Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, Anders Wesslén

  • DOI: https://doi.org/10.1007/978-3-642-29044-2

  • Publisher: Springer Berlin, Heidelberg

  • eBook Packages: Computer Science, Computer Science (R0)

  • Copyright Information: The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer-Verlag GmbH, DE, part of Springer Nature 2012

  • Hardcover ISBN: 978-3-642-29043-5Published: 17 June 2012

  • Softcover ISBN: 978-3-642-43226-2Published: 18 July 2014

  • eBook ISBN: 978-3-642-29044-2Published: 16 June 2012

  • Edition Number: 1

  • Number of Pages: XXIV, 236

  • Topics: Software Engineering, Methodology of the Social Sciences

Buy it now

Buying options

eBook USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 89.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access