Industrial validation of test coverage quality

This dissertation reveals the outcome of an empirical experiment which employed 3 industrial case studies to research the effect of coverage testing on software quality. Furthermore, the experiment investigated the relative costs of coverage testing. A number of test suites were made which attained Five different coverage percentages for the metrics statement, branch and basis path coverage. Test suites comprised mainly of test cases which were developed in accordance with the test-driven development methodology. We reveal that a positive correlation is likely to exist for each metric between the coverage % which is achieved by a test suite and the amount of faults that are found.

Contents

1 Introduction
1.1 Motivation
1.2 Software quality
1.3 Research questions
1.4 Approach
1.4.1 Info Support
1.5 Results
1.6 Overview
2 Preliminaries
2.1 Software testing
2.2 Test methods
2.2.1 Black-box versus white-box
2.2.2 Mutation testing
2.3 Flow graphs
3 Coverage Testing
3.1 Coverage testing
3.2 Example code
3.3 Metrics
3.3.1 Statement coverage
3.3.2 Branch coverage
3.3.3 Path coverage
78 CONTENTS
3.3.4 Basis path coverage
4 Related work
4.1 Garg, 1994
4.1.1 Experiment design
4.1.2 Results
4.2 Frankl and Iakounenko, 1998
4.2.1 Experiment design
4.2.2 Results
4.3 Lyu, Huang, Sze and Cai, 2003
4.3.1 Experiment design
4.3.2 Results
4.4 Cai and Lyu, 2005
4.4.1 Experiment design
4.4.2 Results
4.5 Conclusion
5 Approach
5.1 Introduction
5.2 Design
5.2.1 More on test suite creation
5.3 Execution
5.4 Analysis
5.5 Case studies
5.5.1 Integrity Service
5.5.2 Insurance Administration
5.5.3 Hosted Business Suite
6 Results and discussion
6.1 Case study 1
6.1.1 Statement coverage
6.1.2 Branch coverage
6.1.3 Basis path coverage
6.2 Case study 2
6.2.1 Statement coverage
6.2.2 Branch coverage
6.3 Case study 3
6.3.1 Statement coverage
6.3.2 Branch coverage
6.3.3 Basis path coverage
6.4 Costs versus fault percentage
6.5 Evaluation
6.5.1 Overview correlations
6.5.2 Merged results
6.5.3 Fault detection capability
6.5.4 Threats to validity….

Source: University of Twente

Download URL 2: Visit Now

Leave a Comment